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Abstroct ‘i'ne primary objective of the project was to develop an opera- 
tionally feasible process by which the Calif. Dept of Water Resources 
(DWR) could use information derived frem the analysis of Landsat imager, 
together with supporting lar^e scale aerial photography and ground data,' 
to obtain irrigated acreage statistics on a regional basis (l.e., state^ 
wids) » Th6 ni0thods d0V8lop0d w 6 i ?0 d0nionsfc!rafc0d/'fcos‘b0d in 3 , survey of 
ten California counties (13,7^5,000 acres). Three dates of Landsat 
ianagery were chosen for the estimation; June, August and September, : 

A three-phase sample desiga with cluster units was chosen for the i 
study and Involved landsat Interpretation (Phase I), large scale aerial 
photography interpretation (Phase II) and ground measurement (Phase II 
The san^le units at each phase were a sub—saicple of the sample units a 
the previous phase. Since estimates were required on a county basis, 
a stratification by county was also used. 

Manual interpretation techniques, were developed and utilized to est ' 
mate the proportion of the final population (3,707,000 acres) that was 
irrigated. Of the final population interpreted, 80. 17^ was estimated to 
be irrigated (2,971,827 acres). The relative error of these estimates 
'rfas 2,"'' 
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Preface 


The Irrigated Lands Project had three main objectives: (1) to develop an 
operationally feasible process lidiereby satellite imagery of the type procured 
frcm Landsat can be used to provide irrigated acreage statistics on a’ regional 
basis; (2) to develop a tecteiique that Tsould allow the California Department 
of Water Resources (DWR) to perform this inventory for the entire state of 
California in a one year period and have the data available for publication 
within six nmths following the end of the calendar year of the inventory; 
and (3) to achieve a level of accuracy for the test area and the state to 
within + 3% at the 997o level of confidence. 

In ccnjunction with DWR, ten counties representatatlve of much the 
agricultural diversity found in California were selected for investigation. 

The population of 'interest for sainpling purposes was extracted from the total 
area (13,744,640 acres) of these ten counties. A number of land uses found 
in these counties were not subject to irrigation and therefore were excluded 
frcm consideration. Additionally, areas where information on irrigation 
practices was so good as to make saoq^ling unnecessary were also excluded 
(e.g. established orchards, vineyards, wildlife refuges). After exclusion, 
the total peculation subject to sanpling and interpretation was 3,706,726 acres. 

The selected sarnpling strategy was a three phase sanpling design based on a 
sanpllng frame of area units (clusters) with stratification by county. 

Therefore, within each county (stratum) , of the N units in the sanple area, 
n* . Phase I sanple units (SU) were chosen at random. Each of these n* xanits 
were interpreted on Landsat imagery to determine the proportion of its land 
that was irrigated. Frcm the n* units, n* Phase II SU's were chosen at randan. 
Interpretation of large scale aerial photography was performed on these n’ 
units. Finally n Phase III sancle units were randcmly selected "frcm the n’ 
units for ground measuronent. In total, 1292 Phase I, 90 Phase II and 18 Phase 
III sancle units were used. A regression model link was used to relate the 
larger scale photo and Landsat variables, and an additional r^ression link 
was used to relate the ISP data to actual ground measurements . 

Frcm the outset, the advantages offered by the tnultidate capacity of 
Landsat for monitoring an agricultural growing season were obvioxas . Three 
time periods -were selected for analysis ; early June to monitor small grains 
and establish a base for multi-cropping; August xdien maxiimm canopy cover xsas 
ejqiected for many irrigated crops in this area, and Septaaber, for further 
observations on multiple cropping. The three-phase, three-date measxjraaent 
procedure called for large scale aerial photography to be acquired on three 
dates for each of the randcmly selected Phase II sanple units . A Twin Ccomanche 
aircraft, equipped with a vertical closed- circuit tv systan and Nikon 35nn 
camera set-xap was xased. After enlargement (1:19,000 - 1:22,500) t±ie 
photogr^hy -was mosaiced into strips that covered each sanple unit. Each SU 
was one mile wide and varied in length from four to nine miles . Ground data 
for a sao5)le of the Phase II xjnits vjas collected simultaneously or within 
several days of the acquisition of the large scale photography. 


Preceding page blank 


iii 



Inteipretation was done on moltidate Landsat mosaics (enlarged to 
approxiinately 1:154,000) and the large scale aerial- photography to estimate 
the proporticn irrigated. The -resulting information was tabulated and input 
to a fortran progran O^iPHASE) so that statistical correlations between the 
matched sanple units at all three phases could be made. MPHASE was used to 
calculate the tmiltiphase estimate, the variance, standard error and relative 
error, as well as the sanple correlation coefficients for each county. Of the 
total land in the population (3,706,726 acres), 80.17% was estimated to be 
irrigated. Ihe relative error of these estimates is 2.73%. Since the population 
saapled in this study represents • less than bald the agricultural land in 
California, it would be assumed that a similar san^jle covering all die land 
would achieve a smaller error term. An error term on the order of the + 3 
percent at the 99% level of confidence desired by IWR would be expected if 
such a state-wide inventory was performed. 

An evaluation as to the meaning of HP’s results led to three general 
conclusions: (1) as far as unit costs are conce3cned, HP ccnpared favorably 
with a- hypothetical DWR-style survey of irrigated lands, (2) HP results, 
when considered for the entire stndy area, closely approximate those of 
comparable surveys and they do so at relatively high accuracy, and (3) ei^erience 
from HP indicates that its design objectives conceming timeliness are still 
realistic . 

One major recoEnnendation suggested .itselt in the course of the project; 
that of applying a detailed stratification for more optimum allocation of 
sanple units. -This stratification would be based on cropping practices/ 
envircnmental conditions as they affect both irrigation procedures and 
interpretation techniques. 

The success of the project has depended greatly on the continuing growth 
of interest and participation by IWR. This strengthening cooperative 
interaction has led to follow-on project work in \Aiich we (EWR and the 
University of California) will inplement the reconmendations derived fron 
this research on a larger regional danonstration and expand the research to 
include conputeoT' assisted analysis techniquees and crop identification 
procedures . 
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ItO Introduction and Objectives 


For nfore than 25 years the CaJLlfomla'. Department of -Water.' Resources (DWR) 
and- its predecessor agencies’ have conducted- surv^s deMgned to monitor the., 
deveiopirent of the state’s lands to assess the changing needs. for mtef ' 
management. California receives an annual average of 200 million, acre-feet ‘ 
of precipitation, most of the runoff (anmounting to approximately 35^- of the 
total precipitation) occurs in areas with the -lowest population densities. ’ ' 
Because of this, '.the state has constructed large-scale systems; to store and 
transport water from areas of "surplus" to areas of "scarcity". 

California Water Code Section 10005 established the -California Water Plan 
in 1957 • It Is a ."comprehensive master plan to guide and coordinate the 
planning and construction of works required for the control, protection, 
conservation and distribution of the water of California to meet present and , 
•future needs for .all beneficial uses and purposes in all areas of the State I" 
In addition to establishing the California Water Plan, Water Code Section 
10005 assigns to DWR the responsibility for updating and supplementing the 
Plan. , • • . 

"The Department carries out this responsibility through a statewide 
planning program, which guides the selection of the most favorable pattern 
for the use of the State’s water resources, considering all reasonable 
alternative courses of action. Such alternatives are evaluated on the b^is 
of technical feasibility and economic, social, and institutional factors. 

The program conprises: 

• Periodic reassement of existing and future demands for water for all 
uses in the hydrologic study areas of California. 

• Periodic reassessment of local water resources, v/ater uses, and the 
magnitude and timing of the need for additional water supplies that 
cannot be provided locally. 

Appraisal of various alternative sources of mter - ground water, 
surface water, reclaimed waste water, desalting, geotheniHl resources, 
etc. - to meet future demands in areas of water deficiency. 

• Determination of the need for protection and preservation of water in 
keeping with protection and enhancement of the environment. 

p 

• Evaluation of v;ater development plans." 

To meet these needs the DWR has long recognized the need for specific land 
use data as an aid to state water planning. Since the late 19^0 ’s the- 
Departn^t has been performing a continuing survey on a five tb ten year 
cycle to monitor land use' changes over the state. Because of the costs and 


^Bulletin No. l60-7^, '”Tne California Water Plan Outlook in 197^," Department 
of Water Piesources, November, 1974. 

^ Ibid 
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manpower efforts involved, only a portion of the state is surveyed during a 
given year. The Department has conducted two kinds of surveys, (1) land use 
surveys to record the nature and extent of present water-related land 
developnent, and (2) land classification surveys to determine the location 
and extent of lands with physical characteristics suited to specific kinds 
of development . Land use surveys , which are the most pertinent to the 
Irrigated Lands Project (ILP) described in this report, are conpiled through 
the interpretation of current aerial photography (35 mm slides) supplemented 
with field Inspections. The acreage of each specific category of land use 
or class is determined for each county portion of the survey area, for each 
quadrangle map, and for other area subdivisions such as water agencies, or 
hydrographic areas. Pigures 1 and 2 show the land use legend and a conpleted 
land use map respectively, as conpiled by DtiR. 


As can be seen from Figures 1 and 2, each parcel of agricultural land has 
as a prefix a symbol designating that parcel as either .irrigated, "i" or 
non-irrigated "n”. This condition is determined jfrom the aerial photography 
acquired for each county on a single date basis (usiaally early July) and the 
supplementary field data. Due to the limitations of the one date survey, 

DWR is not able to determine the proportion of acreage devoted to multiple 
cropping or the acreage of small grains (these may be irrigated or dry fanned) 
which are often harvested by the date of the survey. 


Because of the lirportant need on the part of DWR for periodic tabulation 
of the statewide acreage of agricultural land receiving irrigation, the Remote 
Sensing Research Program (RSRP) of the Ikiiversity of California at Berkeley, 
working closely with personnel of DWR, engaged in an investigation of the 
feasibility of using Landsat imagery for the inventory and monitoring of 
Irrigated agricultural lands in the state of California. Judging from the 
results of this investigation, information acquired from the analysis of 
satellite Imagery, such as that to be collected by the ILP, can become a 
valuable supplement to the land use information presently collected by DIa/R. 
Satellite image analysis offers DWR the opportunity to collect data on 
several dates during the growing season and the opportunity to collect 
data over the entire state in one year. The ILP is designed to collect data 
for only one parameter, that of irrigated acreage and, therefore, is designed 
to enhance, not; replace, the present DWR Land Use Stirveys. 


1.1 Objectives Several meetings between DWR and ILP personnel were held to 
determine how the. ILP could best be structured to meet the needs of DWR. 

The major objectives, accuracy requiranents , timeline requirements, and 
operational processes were outlined through this cooperative effort. The 
results of these meetings are as follows : 
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of POOR QUALITY 


AGRICULTURE 

Each parcel of agricultural hind uho U Inbolcd with a noUtlon conrtlaUnic banlcally of throe nymboU. Tho 
flrat of Ihoao l» a lower cone '*i** or “n** IncUcatlng whether tho parcel In Irrlgntod or rtoolrrlanted. Thia In followed by 
capital loiter and number which denote tho line Rfoup and specific u#e as shown below. 


C SUBTROPICAU FRUITS 
t Or sp* fruit 
3 

3 Or«tiK«» 

4 Daits 

5 Avootboa 

6 Oliva » 

7 Ml4callanaoua auLlropIra] 
frulta 

D OSCIDUGUS FRUITS AND RUTS 
1 AppUa 
3 Aprieata 

3 Charriaa 

j faStihaa and Naciartnai 

6 Ttara 

7 riuma 

4 Prunva 
9 PiKt 

10 Mlaeallanaoua 01 tnUecl daeid* 
uoum • 

12 Almonda 
IS Walnuta 

C GRAIH AKD KAY CROPS 
I Barlay , 

3 ffhaat 

5 OnU 

d SfliealUnaoua and mlxad hay 
and rain 


F FIELD CROPS 
t Gotten 

2 SnKlowtr 

3 Flax 

4 Hnpa 

5 9ufar boat a 

0 com (flald or awaet) 

7 Q/aln aorghuma 

B SuiUn 
9 Caator baana 
10 Baana (dry) 
it Mlacallanaoua field 

T TRUCK AND BSRRY CROPS 

1 Artlchotaaa 
3 Aapara^ua 

3 Baana (fraarO 

4 Cota cropa 
B Carrota 

7 Calary 

$ Lattuca (all typaa) 

9 Malona,a<)u«ah,andcucumbara 
(all Idnda) 

10 Oniona and larlle 
it Paaa 

13 Polaioaa 
13 Swaat petatoaa 
t4 Spinach 

15 TOmatota 

16 riowara and nuriary 


18 Mlacallanaoua truelc 

19 Buahbarrlea 
30 Strawbarrlaa 
21 Pappara (all typaa) 

P PASTURE 

1 'Alfalfa and dfolfa 

2 Clevar 

3 Mixed paatura 

4 Nattva paatura 

V VINEYARDS 


I IDLE 

1 Land cropped within the pa at 
thraa yaara but not tilled at 
tlma of aurvay 

3 Now landa faelnf prepared for 
crop productlo 

S SEMI AGRICULTURAL AND INCl 
DENTAL TO AGRICULTURE 

1 Farmttaada 

3 peed Iota (llvaatoek and poul 
try) 

3 DakUa 

4 Lawn area a 


Special condlKona are indicated by the foliowins additlonol symbols and combinations of nymbots 


A ABANDONED ORCHARDS AND VINEYARDS 
f FALLOW (tilled but not ^.roppad at time of aurvay) 
S SEED CROPS 


Y YOUNG ORCHARDS AND VINEYARDS 
X PARTIALLY IRRIGATED CROPS 


INTERCROPPING (or Intarplantlna) la Indlcatad as followat j P-13:?y « a melon crop planted between 

T9 rows of youne walnut trey a 


UC * URBAN COMMERCIAL 

UC 1 MlaeaMansoua aatabliihmanta (offlcaa and re* 

^ , tallcre) 

Jj UC 3 Katela 

UC 3 Motfla 

UC 4 Apartmenta, barracks (thraa family unlta end 
lararr) 

UC 5 Inatilutlona (hospiiali, priaoiia, raformaiorlea. 

aaylUfliSf ale>i having u reasonably «labla 34« 
realdtnt pcpulailon) 

UC 6 Schools (yards m.^ppad aaparately If lara* 

enaugh) * ' 

UC 7 Municipal aurtitofiuma, theaters, cliurchea, 

bujldlnfte. and stands associated wJiii rnee 
track!, football etadlums, baseball parkt. rodeo 
arenas, etc. 

UC B Mlicelianeous hiah wsiar use (indicHtes n hlfth 
water use not covered above) 

U1 - URBAN INDUSTRIAL 

Ul I Manofeeturiilf, eseenibtJnfi, and grnerat pro- 

ceaiin« 

Ut 3 extractive Industries (oil fields, rock <]u<irriea, 
crevel pita, public dumps, rock and travel 
proessslnit plants, etc.) 

U( 3 Storsifa and dIsItIbuUon (warehouses, eub« 
atatlona. railroad marshalling yards, tank farms, 
etc.) 

Ul 6 Bawmilla 

Uf 7 Oil rsflnerles 

Ul a Baprr mills 

Uf 9 Meat packlnc plants 

Ut ID 8taal and aluminum mlfls ^ 

Ul tl Fruit and veceiubla cmnerlaa and xenarat food 

procebaliiif 

Ul 13 Miscellaneous hi«h water use (Indicates tt hi|th 
water use not Covered above) 

:?igure 1. Lesend developed by 
Water Resources and employed in 


UV • URBAN VACANT 
UV 1 Miscellanaoua unpoved cnees 
UV 4 Miscetlensous paved er«si» 

UR . URBAN RESIDENTIAL 
One and two family units. Includine trailer courts 


RECREATIOK 

RESIDENTIAL 

Percnansin e>id sixnmsr ftom* 
primarily recreational area. (The 
number of houses per ecre la Indicated by 
number in the symbol > 

COMMERCIAL 
Commatcioi areas within a primarily racreadonal 
area (includes motala, resorts, hotel 
ate,) 

CAMP AND TRAILER SITES 

Camp end trailer alias in a primarily recreational 


NV NATIVE VEGETATION 

NR RIPARIAN VEGETATION 

NR t Swamps and marahes 
NR 2 Meadowland 

NW WATER SURFACE 

NC NATIVE CLASSES UN8EQREQATED 

the California Department of 
their land use surveys, 
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^Figure 2. A representative exanple of a conpleted 7h 
minute quadrangle land use map as prepared by DWR. 










• The primary objective of this Investl^tion is the development of an 
operationally feasible process whereby satellite ijtiagery of the type 
to be obtained from Landsat can be used to provide irrigated land 
acreage statistics on a regional basis. The infoi^nation required by 
DWR is the acreage of land, by county, that is 'irrigated at least 
once during .the calendar year. Por purposes of achieving this priinaiy 
objective, the number of water applications need not- be determined. 

‘ The technique developed should be one that will enable DWR to perform 
such an inventory for the entire state of California, in a one year 
period and to do so every fourth year. The data collected should be 
available for publication within six months following the end of the 
calendar year of the Inventory. The primary intended use of the 
satellite-based irrigated acreage is in .aiding DWR to assess current 
and probable future water demands. Present. land Use, Surveys alone 
do not enable DV/R to directly establish any single given year as a 
base year for irrigated acreage .statistics. 

* The desired accuracy for the test area, and xiltimately the entire 
state is to within ± 3 % at the 99 % level of confidence. 


2.0 Definition of Study Area and Sampling Design 

2.1 Study Area. Although ultimately the imiverse of interest is the entire 
state, tor the scope of this project and in conjunction with DWR, ten counties 
repres^tative of much of the a^icultural diversity found in California 
were- selected for Investigation (see Figure 3). Sites located in the 
Sacramento/San Joaquin River Delta, .Sacramento Valley, San Joaquin Valley, 
Sierra Nevada Mountains and Pacific Coast, provided the opportunity to test 
the p^^cedures ih a number of environmentalHy different areas. The counties 
found in each of the areas mentioned above are as follows: 


Geographical Area 

County 

Sacramento/San Joaquin 
River Delta 

Sacramento 
San Joaquin 

Pacific Coast 

Monterey 

Sacramento Valley 

Sacramento 

Sutter 

San Joaquin Valley 

San Joaquin Basin (N) 

San Joaquin 
Stanislaus 
Merced 
Madera 

Tulare Basin (S) 

Fresno 

Sierra-Nevada Mountains 

Sierra 

Plumas 
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Une population of interest for sanpling- purposes was extracted from the 
total area of these ten counties. A number of land uses found in these 
counties were not subject to irrigation and therefore were excluded from 
consideration. The exclusion areas vjere primarly, (1) urban areas; (2) 
non-agricultural wildlands; and (3) hilly agricultural areas not subject to 
irrigation. Additionally, areas where information on irrigation practices 
was so good as to make sampling unnecessary vjere also excluded (eig. 
established orchards, vineyards, wildlife refuges and military reservations). 
The exact mapped region of each county (the total area was stratified by 
county) which coirprised the population of interest was specified jointly by 
DWR personnel and RSro. An exairple of one of the counties with the final 
population delineated is shov-m in Figure 


2.2 Sampling Design With t±ie parameter of interest defined and the saipling 
population speciiied, it was possible to consider alternative sanpling systems. 
Feasible sampling strategies may be identified as ccnibinations of the following 
f actors r Cl) sanplirig frame and sanpling unit specifications; (2) stratification 
and (3) the use of auxiliary variables. For geographic areas, sampling frames 
usually are constructed as either a point system referenced by coordinates, 
an arbitrary clustering of areas into some convenient size unit (e.g. 
rectangular areas), or a combination of point centered clusters which may 
overlap. In this investigation, three obvious geographic reference systems 
could be used to identify and locate sanpling units: (1) The state plane 
coordinate system; (2) UTl'I coordinate system; or (3) the rectangular land 
survey system. Similarly, stratification c ould be based on political sub- 
divisions (such as county boundaries), DWR planning units, or any number of 
pi^siographic/biologlcal subdivisions (e.g. geologic, soil, agricultural 
field size). In this .situation logical auxiliary variables which should 
relate closely to the actual variable (proportion Irrigated) vrauld-be inter- 
pretations made of large scale aerial photography (LSP) and Landsat imagery. 
These auxiliary variables could then be utilized to construct selection 
•probabilities, e.g. probabllity-proportlOTial-to-size (PPS) sampling and/or 
they could be utilized in a ratio or regression predictive model. 

The project objective (estimation of irrigated acreage) as well as 
statistical and inplanentation considerations all enter into decisions which 
lead to the ''optimum'' strategy for sampling the population. Given that 
photo related variables are a major part of the system, the sanpling frame 
should allow maximum use of the photographic capabilities for a given 
ejpenditure of effort. For this reason, point systems are not -practical; to 
photograph a large ntmiber of different points with a single or pair of 
Images is very costly. A cluster system is more economical since larger 
units allow additional information to be obtained at little incremental 
cost. In this case a cluster system referenced to the rectangular land 
survey was deemed advantageous. 

Stratification by counties was selected based on its importance to DWR 
personnel for estimates by this population subdivision. In addition, advance 
information .on irrigation practices was available by county. Ihls was useful 
in the process' of determining appropriate sample sizes for the selected 
strategy. Further stratification, such as that based on field size, was not 
utilized since irrigation practices in this area did not seem to be related 
to this variable. 
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Figure 4. Sutter County \-d.th the ^inal r>opulation delineated. The final 
oopilation consisted of tlie entire area of the county less 
exclusions. The exclusions, T^tich vere made tip of orchard, 
urban and vTildland areas, are marlced as "X". 
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In surveys where a single parameter is to be estimated or vrtiere additional 
estirrates are mde for parameters of minor iirportance, variable selection 
probabilities based on auxiliary variables can lead to substantial gains in 
precision. This technique however, requires, measuring the auxiliary variable 
for each sampling unit in the population. With a manual system of tnis size, 
cost arxi the associated amount of effort required to Irrplanent a PPS systan 
are substantial. A nuirtoer of addltlcnal parameters also are of interest, at 
least from an experimental point of view. For these reasons v^iable probability 
sanpling was not considered. Instead equal selection probabilities were used 
and the auxiliary variables were en?jloyed to generate ratio or regression 
type estiuators. In particular, a regressicn model link vias used to relate 
the large scale photo and landsat variables, and an additional regression 
link was used to* relate the LSP data to actual ground measurements . 

Two final questions remained to be answered. First, with an area sanpling 
unit (a cluster), should the auxiliary variable be meas’ured for the entire 
population or for cnly a sanple? As discussed above, costs for measuring 
every sanpling unit would be great. However, if only the population proportion 
was desired, an estimate could be obtained vd-thout requiring a proportion for 
every sanpling unit. It still would be desirable to use a sanple, however, 
unless the sample size required approached the population size. Second, 
should the auxiliary variables be measured for the entire cluster or should 
subsanpling be used to generate estimates of sanpling unit values? Since the 
whole sanpling unit was readily available for measurement, there was really 
no need to consider subsanpling v^iich would add an additional conpcxient of 
variability into the estimates. 

In summary then, the selected sanpling strategy was based cxi a sanpling 
frame of area units flusters) with stratification by county. Therefore, 
within each county (stratum), of the N units in the sanple area, n* Phase I 
sanple units (SU) were chosen at random. Each of these n* units was interpreted 
on Landsat Imagery to determine the proportion of its land which was Irrigated. 
From the n* units, n' Phase II sample units were chosen at random. The 
interpretation of large scale photos was performed cn these n* units to 
determine the proportion of irrigated acreage. In cases where the Phase I 
sanple size was not much smaller than the number of units in the population, 
all Phase I units were measured. Finally n Phase III sanple units were 
randanly selected from the n' units for ground measurement of proportion of 
area irrigated. This then was a three phase sanpling design, since the n 
units were a subset of the n' units, which were in turn a subset of n* units. 

A schematic of the sanpling system is shown in Figure 5. 

Optimization in sanpling systans is difficult because there are so many 
■unknovn factors. A number of assunptions and approximations of unknown 
parameters must be made in an atterpt to arrive at a reasonable and near 
optimal survey system. Two particular parts to this system need to be addressed: 
cluster size and sanple allocation. V.’ith no irifcimation on variability 
associated \d.th various sizes and shapes of cluster 'jnits, the decisions on 
size and shape were based largely cm practical considerations. a one by five 
mile sanpling unit size was selected because: (1) a one mile wide area is 
covered by a strip of 35 nm photography at a scale (1:62,500 negative scale) 
considered sufficient for interpreting Irrigated acreage data (negatives or 
transparencies can be enlarged or projected to provide a good work base), and 
(2) a five mile length is easily located and accurately flown over sever^ dates. 



stratification U ^ Counties 


n« Phase I SU's (1 by 5 nile units), 
selected at random for LAIJDSAT 
measwement of proportion irrigated, 
(y--) are shovm in black. In some 
cases rather than have a sample, 
tne entire county vjas measured on 
LAu'OSAT. 



n' Phase II SU's (a subset of Phase 
I SU's) selected at random for large 
scale photograph measurement of 
proportion irrigated (y')n'«n« 



n Phase III SU's (a subset of Phase 
1— SU's) selected at random for 
ground measurement of proportion 
irrigated (y)n>2 


Figure 5. 


Schematic desi-^i describing the saspling system used in the 
Irrigated Lands Project. 
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For desigi purposes, a preliminary population model was constructed; 
sanple sizes (nur±ier of sample units) and allocaticais were based on roiogh 
parameter estimates of proportion of area Irrigated by county, rough cost 
ratios and a non-linear progratmiing algorithm which minimizes cost, subject 
to constraints on variance. California Experiment Station Bulletin 8^7 
and 1974 County Agricultural Commission reports provided most of the 
numerical data on irrigated acreage. Results of this analysis are shown in 
Table 1. 

Follovdng the formulation of the multiphase sampling scheme described 
above, a literature search was conducted to detennine what had been published 
relative to this estimation procedure. There has been considerable work 
coirpleted by many sources on double (two-phase) sampling, but comparatively 
little on multiphase sampling in general. However, a very detailed and 
thorough' doctoral thesis and a later article by Bhagwan D. Tikklwal covered 
the subject very well. The thesis was conpleted at North- Carolina State 
College in 1955 and the article appeared in the, "Review of the International 
Statistical Institute," Volume 35:3, 1967. Both treat multiphase sampling on 
several occasions. Other helpful references were Cochran (1953) and Raj (1964). 

The estimators are of the regression type. That is, the model assumes 
a linear relationship between certain variables and sanple estimates of 
the irecdel parameters are generated. Ihe estimators are also' iterative such 
that the Phase III (gpound) estimator uses the Phase II (LSP) estimator which 
in turn uses the Phase I (Landsat) estimator. The parameters requiring esti- 
mation are the proportions* of irrigated land within the sampling region of 
each county using all three phases together. In order to estimate these 
parameters it is necessary to obtain estimates based only on Phases I and II 
and estimates based only on Phase I. Therefore, for" each county .there will 
be a set of three population parameters: (1) Irrigation proportion determined 
from Phase I, (Y*); (2) Irrigation proportion determined from Phases I and II, 
(Y')j and (3) Irrigation proportion determined from all three phases, (Y). 

Their corresponding estimators are denoted and Y. The last of these 

is the end result; Y* and Y’ are only used as needed to obtain 

Tne fact that the sample units are considered as clusters and that 
these clusters are of unequal size affects the estimators. It reqirires 
accurate measures of the sizes of the individual sample units. Weighted 
means may then be used in the estimators rather than unweighted means 
(unweighted means would increase the variance of the estlmnates). 

The Phase I estimator is a simple weighted average (see Table 2 for an 



i=l 
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• • Table 1. Preliminary saitple size sunmary-for the ten 'county study area 
(based on historical Information). 

Assunptions : Based on computer run of PCDPAK on 14 May 75 09^46:45 

1. Desired error = 3^ for the entire state (assuming 10 counties 
represents half of the agricultural land in California) 

2. Probability level = 99^, t = 2.567 

3. Correlation between Landsat and LSP = 0.90 

4. Cost ratio (landsat ; LSP) = 1:10 (and LSP:Gromd as well) 

5. Correlation between LSP and ground = 0.95 


6. Stratification data and sanple sizes: 


Strata (county) 

N 

P 

( 

w 

^wi=.5) 

Sample Sizes 
n* ^ n’ n ■ 

Landsat I^P Ground 

Presno 

350 

.9146 . 

.1585 

215 

25 

2 

I-federa 

79 

.9870 

.0355 

28 

7 

2 

Merced 

149 

.9463 

.06725 

68 

9 

2 

Monterey 

91 

.9050 

.0408 

*72 

7 

2 

Plumas 

54 

.5855 

.0235 

«49 

6 

2 

Sacramento 

82' 

.8597 

.63705 

*65 

7 

2 

San Joaquin 

187 

.9101 

.08435 

86 

14 

2 

Sierra 

20 

CO 

vo 

• 

.0087 

*14 

4 

2 

Stanislaus 

' 150 


— 

«50 

9 

2 

Sutter’ 

93 

.8663 

.04435 

*78 

8 

2 


1260 


.5000 

725 + 

96 

20 


%easure whole county 

7. n* and n’ were detemined by ilLP routine FCDPAK.^ n is the 

minimum desired sanple size considering the very high correlation 
that is expected between LSP and ground measurements. 


•2 

•^A nonlinear allocation algorithm developed by M. J. Best at the University 
of Waterloo, Canada. It has been adapted for use on the Unlv^sity of 
California CDC 6400 computer. 
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Table 2. Definitions of notation (for, a 
particular stratum) 


Symbol 


• Meaning^ 


N 

n* 

n' 

n 

% 


M' 


M 


a* 

a' 

i 

a. 

1 

Y« 

^i 


Y* 

^i 


Population size of units to be sanpled 
Phase I (LAM3SAT) sanple size 
Phase II (Large-scale photo) sanple size 
Phase III (Ground) sanple size 

Size of sanple imit i (any consistent unit of measure) 

1 A* • 

Mean phase I sanple .unit size; = — «. \ 

.lean phaae-II sa^le unit slae; K' - ^ f M, 

— 1 ^ 

Mean phase III sanple unit size; M = ~ ^ . 


Irrigated area in' sanple unit „i of phase I 
Irrigated area in sanple unit i of phase II 

Irrigated .area in sanple unit i of phase III 


Irrigation proportion in sanple unit i of phase I;' Y| = 
Irrigation proportion in sanple unit of phase II; = a|/M^. 


Irrigation proportion in sanple unit i of phase III; = ®'i'^^i 



V 

^Y«,Y* 

A ' 

Pyi^Y 


Sanple standard deviation for ^-jeighted phase I observations 

Saiple standard deviation for weighted phase II. observations 
Sanple standard deviation for ^ifeighted phase III observations 

Sanple correlation between weighted phases I and II 
Sanple correlation between v/eighted phases II and TII 
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( 2 ) 


The Phase II estimator is: 
n’ 





Note that this (eq. 2) uses the Phase I estimator Y*. The first term is 
the weighted Phase II mean and the second is its regression .correction. The 
regression coefficient is the term involving the correlation and the standaixi 
deviations. It may be seen from this that higher correlations between Phases I 
and II Increase the effect of the correlation tern (which may be either 
positive or negative). Also, the smaller the Phase II standard deviation is 
in relation to the Phase I standard deviation, the snaller the effect of 
the correction term becomes. These same remarks apply to the Phase III 
estimator, v/hich is of exactly the same form: 



This final estimator introduces a difficulty because of the small Phase III 
sample sizes used in the HiP (n ranges from one to three). The saitple standard 
deviations and correlations either are not defined (in the case of n=l) or 
there are not enough observations to produce reliable values (in the cases 
of n=2 or n=3). To avoid this difficulty, the standard deviations and corre- 
lations used in the Phase III estimator are coi^uted from the combined 
observations of all the strata (counties). .This insures ^ough degrees of freedom 
to get stable estimates at the cost of using observations from alien strata. 

The estimator ^ is the end result needed. It is the "best" estimator in the 
sense that it has the minimum variance of any unbiased estimator of the given 
linear form. 

The variance estlirators are also conputed in an Iterative manner. The 
Phase I estimator is slnply the variance of the weighted observations for 
simple random saipling with a finite population: 
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This depends directly on the Phase II standard deviation and uses the Phase I 
variance estimate. The last term (- ^ ,2/N) is the decrease in the variance 
caused by sanpling from a finite population. The Phase III variance estimator 
is of the same form: 


A 

VAR 


CTy 


1 -^ 


n 


Y»Y 


, p 

A /a\ 


r 

VAR (Y’I 

/V AX 

_ _ 1 


-^Y'Y 0y‘^ 


( 6 ) 


A single FORTRAN program, named I'lPHASE, was written to conpute three 
phase estimates and the associated variance estimates. It was designed- to 
handle as rrany as seven Variables of interest in a single run, so that 
variables other than Irrigated proportion (i.e. small, grain and multiple 
cropping proportions) can be estimated if desired. These variables need 
not be input directly. A special PQRIRAN subroutine is used to transform 
the input variables into the variables of Interest. This is convenient for 
this project because dot counts may be used as input and changed to proportions 
within the program. In the absence of a third level of information, MPHASE 
can be used for two phase estimates also. In either case, there is the 
option to combine the observations from different strata for the two phases 
with the least observations in order to obtain more stable standard deviation 
and correlation estimates. Mbdifications to the original MPHASE allow it to 
accept variable cluster sizes and to weight the proportions appropriately, 
as well. 


2.3 Allocation of Sanple Units The three phase sample design required 
sample unit selection at ail tiiree phases . A description of the total 
popoLation fron xdiich the sample units were chosen is found in section 
2.1. The appropriate county boundaries and exclusion areas were 
delineated on 1:1,000,000 scale Landsat color ccnposite transparencies 
and 1:250,000 scale USGS quadrangles. The county boundaries were trans'fered 
from the USGS quads to the Landsat transparencies using a Bausch and Lomb 
Photogrammetric Rectifier, Bausch and Lomb Zoom Transferscope and visual 
location. The exclusion boundaries were delineated directly on 1:250,000 
maps by DWR district personnel and were transfe?ed to the satellite imagery 
using the same methods. Once the population had been accurately defined,- 
selection of the SU’s proceeded. 

A grid of east-west oriented one by five mile units (as described in sec- 
tion 2.2) v/as superimposed on the population. County and stratification 
boundary irre©lLarlties caused a practical range of grid sizes from one-by- 
four miles to one-by-nine miles. Each unit v/as then numbered, and random 
number tables were used to select the Phase I (Landsat) SU’s. 

Fran this newly defined and smaller set, the appropriate number of 
Phase II (I2P) sanple units was randomly selected for eachp;pounty . Pollovflng 
this selection two’ SU’s from each county were rarKiomly chosen from the set 
of Phase II sanple units to be the Phase III (ground data) SU's. Figure 6 
shovTs Sutter County v/ith the Phase I, II and III SU's delineated. 
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Figure 6, Sutter County \<dth the three ohase samole units illvLstrated ' In 
Sutter County all the Phase I (Landsat) SU's were interpreted, 
therefore, the total county acreaf^e less exclusions (X) vTas 
X interpreted. The Phase II (large scale aeral photograplw) sample 
units are the eight rectangles delineated above. The two Phase II 
9 sample units outlined with the heavy line are the Phase III 

(ground data) sample units. 
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3.0 Acquisition of Imagery and Groijnd Data 

3. 1 The Selection of Phase I Landsat Photographic Data Fran the 
outset the advantage ottered by the multidate capability of Landsat for 

factors were considered before the selection of the optimum dates for inter- 
pretatiai: (1) expected crop calendar, (2) county cropping practices, (3) 
historical cropping trends, aixl (^^) harvest dates (especially critical for 
crops that are in a mlti-crop sequence). Based cn these factors as well 
as prior experience in this geographic area and meetings with DWR district 
personnel and University Agricultural Extension officials, three time periods 
of Landsat imagery were selected for analysis. These periods v;ere early June 
to noiltor small grains and establish a base for riailtl-ci'opping; August when 
maximum canopy cover was expected for many Irrigated crops in this area ard 
September, for further observations on double cropping and its inpllcation 
on the total irrigated acreage. Due to tte orientatlcn of Landsat *s orbit 
with respect to the northwest-southeast trend of the Sacramento/San Jc^quin 
Valley three passes of the satellite were needed to provide coverage in 
each time period. 

Figure 7 Illustrates the orientation of the orbital passes in relation 
to the ten county study area and the dates of imagery for each pass that 
were used in the study. 


3 2 The Acquisition of Phase II Large Scale Aerial Photo^aphy Ihe 

selected Phase II samole units. Each photo mission vtas to correspond with 
the Landsat overpasses used in the study ^ On the first date (June 2-6, 1975), 
the pilot located the (xie-by-five mile SU's (which had beai delineated on 
county topographic maps) and obtained photography for all counties but 
Plums and Sierra (these are the Sierra Nevada Pfountain counties which were 
still snow covered). For this flight as well as the ranalnlng flights a 
Twin Conranche aircraft, equipped with a vertical closed circuit TV system 
and Nikon 35 im camera set-up, was used. After ailargenent to the standard 
3R size (scale 1:19,000), the June photography was mosaiced into strips that 
covered each sarple unit. On the subsequent dates, the pilot was able to 
precisely locate the starting, ending and center line of the flight lines by 
using the June flight line photo mosaics and the vertical closed circuit TV 
system. Conparison of ground features on the TV screen with the photo mosaic 
enabled this precise location. To ensure coverage, the second and third 
dates of photography were flown at a slightly higher altitude with a resulting 
scale of 1:22,500 after enlargonent. 

Tlie second flights, planned to correspcnd with the maximum canopy cover 
expected in August, took place on August 3, 13 and 15 3^-1 counties but 

rionterey. Plums and Sierra. Coverage of Ilcaiterey was obtained on August 29 
and coverage of Plums and Sierra counties on September 5, 1975* Final 
coverage for Fresno, P!adera, Merced and Stanislaus coi;nties v.’as obtaLned 
on September 29 and October 2, 1975- I-fenterey , Plums, Sacramento, San Joaquin, 
Sierra and Sutter counties vrere corpleted on October 1^, l6 and 28, 1975* 

Poor weather conditions in September delayed the acquisition of the Phase II 



Pigure 7* The Landsat orbital paths and dates of imagery used for the study. 

The square delineated on the most northern track illustrates the 
approximate area enconpassed by one landsat frame. 
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photograplr^y until after what was considered, the cptirnum time fl’ame. 

For each date and for each sanple unit, mosaics of the l^ge scale photo- 
graphy were made. Each mosaic had the sanple tinit precisely delineated and 
was labeled by county, date, sanple unit number and direction of night. The 
mosaics were then stored in looseleaf binders for ease of removal and multi- 
date conparison. Figure 8 shows a representative ejsnple of the Phase II 
multidate aerial photography used in the estimation of irrigated lands. 


3,3. The Ac<^sition of Phase III Ground Data In order to correct 
the estimations made ot irrigated acreage on the large scale aerial 
photography and landsat imagery, sanples of the Phase II SU's were 
visited on the ground, in each comty two Phase II sanple xmits w^e 
randomly’ selected for the collection of ground dara. Field mps were prepared 
from the photography acquired on the June LSP missions. Crop type and 
irrigated/non-irrigated information for each field for each of the three dates 
vra.s annotated on the field maps. The DVJR land use code (Figures l and 2)- 
utilized for the ground data collect iCHi. Figure 9 sho^^s the ground data 
collected to correspond with -the three dates of ISP’s seen on Figure 8, For • 
the June collection of ground data, several days elapsed between the acquisition, 
processing and mosaicing of the LSP and actual collection of data. On the 
subsequent dates, the first date mosaics were used as ground maps and the 
field. views collected ground data (Phase III) sirnultaneously with the acquisition • 
of the Phase II large scale aerial photos. 


4.0 Interpretation of Landsat and Aerial ]inage 3 ry 

4.1 Phase II Large Scale Aerial Photography Interpretation and Tabulation Procedures 
_ _ —'Each Phase IT sanple unit was iiTfcerpreted on the large scale aerial 

photography j (1) to obtain an estimate of the proportion of the agricultural 
area with the SU that was irrigated and (2) to obtain an estimate of the 
Irrigated area within the entire SU. The estimations v/ere made on mosaics 
of each SU constructed from the 35 mm aerial photography for each of the June, 

August and Septeraber/October dates. On each of these mosaics, the perimeter 
of the sanple units vjas first delineated. A clear acetate overlay ’V'/as placed 
over the fall date photography and registration and identification symbols 
and numbers were annotated. 

Once the photos were prepared for Interpretation, each SU was assigned 
to an appropriate field size class. Measurements vrere made on the most 
westerly one-square-mlle area of the sample unit. The average field size 
vathln the one-square-mile area was determined and the area assigned to one 
of four field size classes; Class I <^10 acres, 16 or more fields per square 
mile; Class II 4l-80 acres, 8-15 fields per square mile; Class III 8l-i59 
acres, 5-7 fields per square mile, and; Class IV >160 acres, ^ or fev/er 
fields per square mile. The puipose of assigi^i^'‘field size categories ■\<;as 
to determine if there vras a positive correlation between field size and 
■percent non-cix>p acreage. To further define the area of the SU into 
agriculture or non-agriculture classes, boundaries v;ere dravffi around urban 
area, najor highways, large irrigation and drainage canals, large areas of 
riparian vegetation, s^^anps, marshes and meadov/land. After these areas 
were excluded, the ranaining area was the actual agricultural acreage that 
vjas to be analyzed. 
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An Interpretation procedure was developed for the remaining agricultural 
acreage that utilized the benefits of a multi-date system to evaluate the use 
of each field in the sanple unit. Looking at each field or group of fields 
in the SU on all three dates, th^ analyst interpreted the use of the field 
from the classification listed below and coded the use on the acetate overlay . 


Table 3* Interpretation code for Phase II large scale 
aerial photography sairple units. 


Symbol^ 

I 

I'll 

G 

G/I 

MC 


Use of Field 

Non-agriculture 

2 

Irrigated 

■3 

Not irrigated 

Small grain (barley, wheat, oats, 
miscellaneous and mixed hay and grain) 

small grain followed by an 
irrigated crop 

Multiple cropping 


1. In practice, color-coded symbols were used. 

2. Most crops actively growing in the Central Valley during the suirmer miths 
are irrigated. Uierefore, a signature which iridicated the presence of 

an actively growing crop in August was called irrigated. Wet soil also 
indicated irrigation. 

3 . Non-irrigated areas included abandoned orchards and vineyards; fallow 
fields; non-irrigated, often native pasture and new land being prepared 
for crop production. 

Following the Interpretation of all the Phase II sample units from the 
eight major agricultural counties by DWR and RSRP, tabulation of the results for 
i^ut to MPHASE was conpleted. Two methods of measurement were used to 
ccxipile the results frcan this phase: (1) tabulated the results of the 
Phase II SU interpretations using the standard cut-and-welgh method, and (2) 
PlSRP's Interpretations were measured using an electronic coordinate digitizer 
(GPJtP/PEJ) and an area coirputer routine (NUIEBY). The GP»AF/PEI'I system 
utilizes a tablet, pai and control box. The tablet has a grid of 2000 x 2000 
points over a 14 x l4 inch area. Vihen the pen is pressed against the tablet, 
the coordinates of the nearest grid intersection are sonically recorded. A 
field can be defined by recording the cooxxiinates of its comers if it is 
regularly shaped or by tracing an irregular edge. The ccmputer program (NIl'IEBY) 
uses the coordinates to conpute the area of the field, expressed as the namber 
of grid points within the field. A slirple scaling factor is then applied to 
the point count to convert to acres . Tabulation of the ground dath results 
was also conpleted using the GPJiF/POi system. 
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Figure 8. Multidate larp;e scale aerial photopraphv used for the ^^se II estimate of proportion 
ijYip^ated. This sanjple unrt, SU08, xs the southern of the t^ijo units outlined hv tl^ 
heavy line on Fij^ire 6. A comparison of the appearance of the fields seen sXbove with 
their appearance on multidate landsat imagery is possible bv reference to Flpnro 10. 
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October 1975 



Fl 4 ?;ure 9. 'Ground data (Pliase III) collected on sample unit SUOS seen as Fit^ire 8. The land use code 
utilized is that vdiich was developed bv U*JR and is employed in their current siirveys 
(Fi^^es 1 and 2) . The "i” symbol indicates that the field was irripated at least once 
durinp the prowinp season. 




Using MPHASE with the measuremaits as described above, sample 
correlations between the large-scale photo (Phase II) Interpretation ana 
ground measurement (Phase III) were arrived at as follows: 


Irrigation proportion 

Multiple crop proportion •971 

anall grain and safflower proportion .S50 

These values, (based on 1^ observations from eight counties, Sierra and 
Plumas viere excluded from this preliminary test)), indicated that there vras 
sufficiently high correlation between Phase II and Phase HI observations 
for accurate three-phase estimation. 




4 2 Phase I T.;m dsat: Analysis and Tab ulation Procedures, Ihe analysis 
o£ the Landsat test area was the last interpretation phase tl^t needed 
to be completed. Color prints enlarged to a scale of apprcKomately 
1:15^1,000 were produced in-house frcxa the transparencies. Extreme attention 
was paid to reproducing each county on each date of Imagery at e^ctly the 
same scale. The enlar^emeits v;ere then carefully mosalced together so that 
each county could be vievjed In entirety on each date. 


County boundaries taken from USGS 1:250,000 topographic sheets ^d 
exclusion areas provided by Dli/R were located on the August date mosaic. 

Location of all the boundaries was done with the aid of a Baush toib 
Zoom Transferscope and reference to NASA-flown hl^ altitude aerial photography 
v.hen it vjas available. In most cases hlghf light photography of the a^ea 
taken within the last six years was found In the RSRP film llbrai^. Although 
high nig ht photography was not an integral Pcirt of the design scheme, nor 
vra.s it used in the interpretation phase of this study, it was very useful in 
the location of county and exclusion boundaries. Since IIASA high flight 
photogr^hy is generally available for the agricultural areas of California 
it can be used to great advantage in a project such as this. 


In order to develop a general technique for the interpretation of the 
Landsat imagery, the Phase III (ground data) sanple anits for each county 
were located cn Landsat mosaics. A ccmparison between the appearance of 
each field on the satellite imagery and that same field on the Phase II 
large scale aerial photography could then be made. It is nrportait to 
remember here that the Phase III .ground data SU’s were a sanple of the Ptese 
II large scale aerial photography. The ground data collected for each of 
these fields provided the training necessary for describing the tones and the 
multidate seouence of tones that allowed discrimination between irrigated 
and non-irrigated areas. Following tills initial review with the three phases 
of Information, a technique for the analysis of the Landsat imagerj' vra.s 
established . This technique is as follows : 


1. An acetate overlay, with appropriate registration marks, county^ ^ 
boundaries and exclusion areas was placed on the August landsat Image. ^<on- 
irrlgated acreage was then delineated. Any crop in a vigorous state of 
growth' in the Central Valley of California In August, and thereby exhibiting 
a bright red color on Landsat imagerj^ was assumed to be irrigated. .Since 
the vast majority of the acreage within the study area was assumed to be 
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irrigated, n»st of the area was Interpreted as irrigated ai this August date 
and hence was removed frc»n further consideration on the June and/or October 
dates. Only fields not showing the bright red color were delineated. 

2. The overlay, annotated vd.th the delineatiais and interpretations, 
was transferred to the June date of Landsat imagery and the fields previously 
called non-irrigated were checked. \i/here necessary fields Included in the 
non- irrigated population v;ere added to the Irrigated acreage. 

3. The overlay was transferred to the Septenber Landsat data and the 
remaining non-irrigated fields were rechecked. 

4. A final check of the interpretations was made. 

This use of the multidate imagery was central to the success of the 
pi'oject. The added informatlCMij made possible by being able to monitor 
the growing seascxi and to inventory areas of multiple cropping, was critical 
to achieving the objectives of estimating total iirlgated acreage and providing 
pertinent infonnation for the classification of crop type as well. 

In order to test the operational use of the Phase I interpretation 
techniques and to obtain sone preliminary figures 01 the correlation between 
the three phases, Sutter County was selected for a test case study. Throu^ 
use of the training and interpretation techniques previously described, the 
Phase I interpretation was conpleted. Measurements of the entire county, 
the D\^/R exclusion areas, major canals and non-lrrl^ted areas were extracted 
using the GRAF/PEIN and were then utilized in the statistical analysis. 

A three-phase estimate of the proportion of irrigated land v/ithin 
Sutter County was coiputed. The sanple region was divided into 9 I sairple 
units, each of which was Interpreted on the Landsat Imagery for proportion 
of Irrigated land. Phase II interpretation was performed on eij^t of these 
units arxi Phase III ground data collected for two of the eight Phase II units. 

This combination option of f^HASE was used to obtain the relation 
between Phase II and Phase III. In total, nine Pheise II - Phase III pairs 
were used fron 5 counties. The correlation between these was .951. The 
correlation between Phases I and II vras also high, .950. The high correlation 
meant that there was a possibility of a significant correction to the Phase 
III mean by the Phase li and Phase I Infomation. The means were: 

Phase I mean .762 

Phase II mean .673 

Phase III mean .834 

The three-phase estimate Wcis .308 with a standard error of .058. The results 
of the Sutter County test case demonstrated that the training and Interpretation 
techniques were providing reliable results and that further modifications to 
the techniques would not be necessary. Flrure 10 shows the multidate landsat 
enlargements used for the estimate of irrigated acreage in Sutter County. 
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June 1975 


August 1975 


Septaiiber 1975 


FiPHjre 10. Multidate Landsat enlarpenents used ^or the estimate of irrigated acreage in Sutter County. 

The success of the proiect was based largely on being able to monitor crons through the 
growing season and inventory areas of multiple cropping. As can be seen, an estimate based 
solely on one of the dates shown above would not provide the comprehensive data desired by DWR. 




On Ifey 18 and 19, 1976, a training ‘session was held at DVM's facilities 
in Sacramento. The main objective of this meeting vra.s to transfer interpretation 
procedures to the D\“i/R personnel who would be cooperating in the Phase I 
interpretation. The objective was met through the presentation of training 
exercises and materials, practical demonstrations and discussion. Pollovjing 
the training, multidate Land sat mosaics, with the final population delineated 
on them v;ere distributed. In addition to the DVffi analysts vitio would be 
participating in the interpretation of Madera, Monterey, Sacramento and 
Stanislaus counties, other Dl® district personnel attended the session to 
become familiar vriLth the project goals and procedures. 

In all, DViR personnel . interpreted 1,071,163 acres of the total 3,706,726 
acres analyzed In the Phase I step. Interpreters at the RSRP completed the 
remaining 2,635,563 acres. In addition to this cooperative effort, DVJR 
enployees. tabulated the acreages of Irrigated and non-irrlgated areas for 
3,09^1,000 of the 3,706,726 acres. RSRP personnel tabulated the remaining 
acreages. The traditional cut-and-weigh technique was used for this measure- 
ment. In this method, paper prints are made of the interpreted area and then 
cut into segments of irrigated and non-irrigated areas. These segments are 
then weighed using a Mettler balance. Since the size of the total sanple 
area had been determined, slirple proportions of irrigated to non-irrigated 
acres were easily derived from the weired segnents. Either the proportions 
or the- weight of each segment (in grams) could be input to the MPHASE program. 
Table 4 lists the weight in grains, proportions and acreages for each county 
as measured by Dl-JR and RSRP. Wei^ts and proportions for each of the Phase 
II and Phase III sanple units as they v;ere interpreted on the Landsat imagery 
vjere recorded separately as well. These individual measurements were needed 
as input to I'lPHASE so that statistical correlations between the matched 
sanple units -at all three phases could be made. For a table listing the 
proportion irrigated for all three phases, see Appendix A. 

5.0 Statistical Analysis and Results 

With the numerical data calculated by DWR and ‘RSRP, the MPHASE progran 
was run for each county. Section 2.2 of this report describes the sampling 
scheme used’ in detail. The main features are repeated here. The levels of 
information corresponding to the phases are: Landsat image interpretation 
(Phase I), large-scale aerial photo interpretation (Phase II), and ground 
measurement (Phase III) . Multi-phase sanpling is characterized by the sanple 
units at each phase being a subsanple of the sanple units at the previous 
pliase. The units then are the same size for each phase. An assuitption of 
this des:^ is that there are strongly positive correlations between adjacent 
phases. The units are considered as clusters because it is desired to find 
results about irrigation proportions per unit area rather than in terms of 
the particular sanple units. 

Since estimates are required on a county basis, a stratification by 
county vias used. VJithin each county there were areas ronoved from the region 
vihether because the area vias Rnovin to be non-agricult ural or because 
DVJR already possessed reliable irrigation, information about the area. A grid 
of 1 X 5 mile sanple units oriented in an esist-viest direction i<?as placed 
over each county. The size and shape was chosen for practical considerations 
involved in collecting and analyzing the data at all tlmee phases, then a 
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Table 4. The weight in grams, proportion irrigated and acreage as interpreted on Landsat. These figures 
were then used- to input to MPHASE to calculate the final estimate. 


County 

Total Interpreted as Irrigated 

Weight (grams) 

Proportion 

Acreage 

Total Interpreted 
as Non- irrigated . 

Total Interpreted 


10.4425 

1.2453 

11.6878 

Fresno 

.8935 

.1065 

1.00 


1,034,936 

123,419 

. 1,158,355 


1.7809 

.7701 

2.5510 

Madera 

.6981 

.3019 

1.00 


170,748 

73,835 

• 244,583 


4.2055 

.8476 

5.0531 

Merced 

.8323 

.1677 

1.00 


416,780 

84,023 

500,803 


1.3333 

.1364 

1.4-697 

Monterey 

.9072 - 

.0928 

1.00 


124,028 

12,688 

136,716 


.4911 ■ 

.4260 

.9171 

Plumas 

.5355 

.4645 

1.00 


34,279 

29,201 

63,480 


2.268S 

2.2431 

4.5119 

Sacramento 

.5028 

.4972 

1.00 


171,360 

169,418 

340,778 


4.9474 

1.0813 

6.0287 

San Joaquin 

.8206 

.1794 

1.00 


488,873 

106,848 

595,721 “ 


.1926 

.0464 

.2390 

Sierra 

.8059 

.1941 

1.000 


17,321 

4,172 

21,493 


' 3.2845 

.3809 

3.6654 

Stanislaus 

.8961 

.1039 

1.0000 


312,810 

36,276 

349,086 


2.3336. 

.7294 

3.0630 

Sutter 

.7619 

,2383 

1.0000 


225,302 

70,409 

295,711 

TOTAL ACREAGE 

2,996,437 

710,289 

3.706.726 






boundapy of the sanple region fell vriLthin one of the rectangulaj? units of 
the grid, a convention was used which allowed the sizes of the sanple units ^ 
to vary between H and 9 square miles . Once this v^as completed, the population 
of units to be sairpled v/as well defined. The number of sample units to be 
allocated at each phase within each county vias then determined, based on 
rough irrigation proportion estimates, cost ratios and desired accuracy. A 
non-linear programming routine vdiich minimized cost subject to these constraints 
was used to do this. Sinple random sanpling was then used to select the 
sample units at each phase. In some counties the nuiriber of Phase I s^le 
units was so close to the total number of sample units in the population that 
ai1 the units in the population at the Phase I level were sampled (see Table 
1). In performance of the Phase I interpretation, it was found to be much 
more convenient and time saving to Interpret the entire population of saitple 
units rather than having to select and precisely locate each of the randomly 
selected Phase I SU*s. Therefore, for each county the total population (N) 
was interpreted at the Phase I level. The final sample size summary is 
shown in Table 5. 


Table 5. Final sample size summary 


Stratum - 
(County) 

N n* 

Popul^ion - Landsat, 

n' 

LSP 

n 

Ground 

Fresno 

348 

25 

3 

Madera 

79 

7 — 

1 

Merced 

155 

9 

2 

Monterey 

•233 

7 

2 

Plumas 

18 

2 

2 

Sacramento 

106 

7 

1 

San Joaquin 

166 

14 

1 

Sierra 

7 

2 

2 

Stanislaus 

109 

9 

2 

Sutter 

91 

8 

2 

TOTAL 

. 

1292 

1 

90 

18 
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MPHASE was used to calculate the multiphase estimate, the variance, standard 

error and relative error, as v/ell as the sanple correlation coefficients for 

each county. Ihe final results are shovni in Table 6. A detailed summary of 

the estimates by stratum or counties, is provided in Table 7. Table 7 shows: 

the total sanple population area in acres, the proportion of the total 

ten-county population each county represented, VJ (e.g. Fresno County represented . 

h 

31.25^ of the ‘total ten-county population); the estiimte of proportion of the 

population that vhs irrigated, (e.g. 90.3Sf of the sanple population in 

Fresno Co\jnty was irrigated); the stajidard error of the estimate designated 

as , (the standard error is an absolute estimate of the nnagnitude of variability 
h 

in sarple estimates v/hlch vjould occur if repeated sanples were taken from the 

same population and this sanpling teclmioue vas used); the stratum sample size, 

(o*C* Fresno County had 25 Phase II sanples); the estimated acreage of 

Irrigated land (the product of the population area in acres, N^, and the estimated 

proportion of the population that vjas irrigated, Y^. Using i^tesno County as an 

exanple, 1,158,355 acres x .9038); the relative standard error, this calculation 

facilitates conparisons of the error associated with sairpling betvjeen different 

counties. It is arrived at by dividing the standard error, Sy , by the estimate, 

_ ^h 

Y^, therefore, for Fresno, .0^1308 - .9038. In studying Table 7, it can be seen 

that riadera and Sacramento Counties show a much higher percentage error (12.3 

and 13.7 percent respectively) than the other counties. If internretation 

competence is assumed to be equal for all the counties, it may be iriferred from 

this that in the future additional sampling effort would be required in these' two 

counties. The table continues wdth the total county acreage, and finally, the 

proportion of the total county acreage that is Irrigated; The estimtes by 

county can be used in planning on a countj' basis as well as an indicator of the 

level of sampling which niglit be required in future sun/eys within these same 

counties. 
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Table 6. Pinal results of the multiphase estimate as calculated using MPHASE 


' 

Multiphase Estimates and Variances 

Sample ^Correlation 

Coefficients 


County 

Estimate 

Variance 

St. Deviation 

Relative Error 

Correlation 

between 

Phases I and II 

Covariance 

between 

Phases I and II 

Correlation 

between 

Phases 11 and III 

Covariance 

between 

Phases II and III 

Fresno 

.9038 

.0019 

.0431 

.0477 

.7849 

.0169 

.9820 

.0044 

Madera 

.5917 

.0057 

.0753 

.1282 

.8387 

.0267 

0 

0 

Merced 

.7973 

.0030 

.0551 

.0690 

.8216 

.0212 

1.0000 

.0071 

Monterey 

.8996 

.0026 

.0507 

.0563 

.9923 

.1228 

1.0000 . 

,1907 

Plumas 

.5649 

. 0021 

.0454 

.0790 

1.0000 

.0101 

1.0000 

.1000 

Plum as- Sierra * 

.6390 

.0021 

.0462 

.0723 

1.0000 

.1009’ 

i.oooo 

.0999 

Sacramento 

.5354 

.0054 

.0735 

,1375 

.9500 

.0411 

0 

0 

San Joaquin 

.8163 

.0048 

.0692 

.0847 

.9821 

.0736 

0 

0 

Stanislaus 

.8463 

.0025 

.0499 . 

.0589 

. 9394 

.0926 

1.0000 

.1070 

Sutter 

.8097 

.0034 

.0575 

!o717 

.9505 

.0864 

-1.0000 

-.0018 

Lumped Standard Deviation and Correlation 

Lumped Phase H Standard Deviation matching Phase III samples 
.2500 

Lumped Phase III Standard Deviation 
.2668 

lumped Correlation between Phases II and III 
. 1)669 
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Table Summary of stratified estimates of proportion irrigated 


h 

County 

Population 
Area (Acres) 

Population 

Proportion 

Estimated 
Proportion of 
Population 
, Irrigated 

Standard _ 
Error of Y. 
S- " 
\ 

Stratum 

Sample 

Size 

"h 

Estimated 

Irrigated 

Acreage 

Relative 

Standard 

Error 

Estimated 

Total Proportion 

County of total 
Area county area 

(Acres) irrigated 

1 

Fresno 

1,158,355 

.3125 

.9038 

.04308 

25 

1,046,921 

.04767 - 

3;S30,400 

.27332 

2 

Madera 

244,583 ' 

.0660 

.5917 

.07580 

7 

144,720 

.12811 • 

1,374,720 

.10527 

» 3 

Merced 

500,803 

.1351 

.7973 

.05505 

9 

399,290 

.06905 

1,269,120 

.31462 

4 

Monterey 

136,716* 

.0369 

.8996 

.05067 

7 

122,990 

,05633 

2,127,360 

.05781 

S 

Plumas/ 

Sierra 

84,973 

.0229 

.6390 

.04620 

2 

54,298 

.07230 

2,257,920 

.02405 

6 

Sacramento 

340,778 

.0919 

.5354 

.07351 

7 

182,453 

.13730 

630,400 

.28942 

7 

San Joaquin 595>721 

.1607 

.8163 

.06918 

14 

486,287 

.08475 

902,400 

.53888 

8 

Stailislaus 

349,086 

.0942 

.8463 

.04986 

9 

295,431 . 

.05892 

963,840 

.30651 

9 

Sutter 

295,711 

.0798 

.8097 

.05749 

8 

239,437 

.07100 

388,840 

.61634 


TOTAL 

3,706,726 

1.0000 

.8017 

.02188 

88 

2,971,827 

.02730 

13,744,640 

.21622 

* 

For Monterey county only the Salinas Valley was included as 

a major agricultural area< 




. ' 




Table 8 summarizes the estimates of proportion Irrigated (within the sample 
population) j the estimated total acreage irrigated, and the relative error as 
calculated for the combined ten county area.' Confidence statements are also 
given for various levels of confidence (e.g. .the 95% of level of confidence, or 
1 ~ a = . 95)> Of the total land area in the ten counties (13,7^^a6^JO acres), . 
2 , 971,827 acres or 21-.6 percent of the total land area is estimated to be 
irrigated. The relative error of these estimates is 2.73 percent, assuming 
acreage measurements xvere without error. Since the population saupled in this 
study represented less than half the agricultural land in California, it v/ould 
be assumed that a similar sanple covering all the land would achieve a much 
smaller error term since the sairpling portion of the state would be sanroled at 
about the same rate. An error on the order of the + 3 percent at the 995 level 
of confidence desired by Pl'/R vrould be expected if such a state-wide inventory 
v/as performed. ’ 

An additional calculation vjas conputed to determine the accuracy gains 
obtained by allocating the sample units by county. This stratification led 
to a 17-575 decrease in variance and thus represents a positive gain. It 
can be assumed that a more sophisticated stratification based on such environmental 
factors as field size or agricultural cropping practices as well as a county . 
stratification would cause an even greater decrease in variance. 

6.0 Evaluiating accomplishments of the Irrigated Lands Project ^ 


A well-designed project often will generate more questions than it ‘sets 
out to answer. So far, this report has dealt with queries relating to the . 
ends and. means of the Irrigated Lands Project (ILP) : Wiat were we trying to 
do?; How did we go about it?; What happened? In contrast, this section deals 
with questions relating to ILP’s meaning: l.e.. So what? 

The open-ended nature of this third line of inquiry should be apparent 
since the purpose of most evaluation exercises is to produce information that 
might be useful in guiding choices among alternative programs and policies. 

No guarantee is implied that the information actually will be useful. All 
evaluative techniques, regardless of how quantitative they appear, are deeply 
Infused with hunan values. As a consequence, such techniques are prone to all 
the fallings commonly associated with human judgement . Wise users thus will 
enploy these techniques as exploratory tools for revealing assumptions, values, 
and judgements, for 'exposing uncertainties, and for formulating new questions. 

Results from the Irrigated lands Project are examined in this same spirit 
of inquiry. A framework for evaluation is created by assuming that ILP results 
are roughly conroarable with portions of the land use survey conducted by Cali-' 
fomia's Department of Water Resources (DWR). The follov/ing questions ensue: 
How do the two approaches ccmpare in terms of their objectives, products, users, 
costs, accuracies, and timeliness?; How fair is the comparison?; \Alhat do these 
results iirply? Answers to these questions are necessarily tentative and par- 
tial, pending further experimentation ivLth more directly conparable data. 
Nevertheless, a thou^tful evaliration at this stage can help guide work to fol- 
low the Irrigated Lands Project. 

? This section was prepared by James M. Sharp, resource economist for the 
Social Sciences Group at the Space Sciences Laboratory. 



Table 8. Siunmaxy of estimates for the 10 county area. 


Standard 

Parameter Estimate Error 

Overall Proportion I 
Irrigated within the 
sample population .8017 

Total irrigated land 2,971, 82 

; (acres) 


.02188 

77,119 

(acres) 


Relative 
STD Error 


.0273 


CONFIDENCE INTERVAL HALF WIDTH EXPRESSED 
as percent of the estimate 

i-a ~ .68 i-a * .95 1-a - .99 

t = 1.00 • t = 1.98 t = 2^58 


2.73 ‘ 5.41 7.04 


0273 


2.73 


5.41 


7.04 


■6.1 •' Objectives . ! ‘An evaluation of IIP acconplishments cannot overlook the 
hierarchy of objectives that surrounds the project and related DWR activities.' 
Objectives within the project itself are research-oriented, aimed at developing 
an operationally feasible process for producing Irrigated acreage statistics 
vdth the help of satellite imagery. Similar ■ statistics , though usuali^ dis- 
aggregated by crop type , are routinely gathered as part of the' DVIR 'surveys 
of water-related land use. VJhen they were Initiated in the late 19^10' s, these- 
surveys were intended ”to identify the nature, location, and extent of present 
land use and lands suitable for various kinds of water-using development."^ 

hi recent years, the Department has supported the land use surveys as 
part of their ongoing planning and management activities. The surveys pres- 
ently serve a variety of purposes: as baseline information for statewide 
long-range forecasts of water and power needs, as a check on coirparable U.S. 
Census of Agriculture statistics, as special Inventories of agricultural 
water uses under exceptional conditions like the cijrrent drought, or as 
general Information of use to non-DWR agencies and individuals. 

-The numerous objectives served by the DWR land use surveys, in combina- 
tion with their greater statistical disaggregation, obviously conplicate any 
attempt to subject ILP results to comparative evaluation. In addition, there 
is the problem of estimating the value of updated land use Information against 
the full range of DWR objectives. What Inpact, for instance, would less cost- 
ly, more accurate, or more timely irrigated acreage statistics actually have 
on DWR water demand forecasting activities? Could other agencies or organiza- 
tions also benefit from the Improved statistics? Are there alternatives other 
than improved land use information that would better achieve DWR objectives? 

It is clear an evaluation of IIP can easily lead past mere "apples and oranges" 
questions to a cornucopia of considerations beyond. 

6,^ ■ Products . The illusory nature of land use planning considerations is 
illustrated by DWR’s land use quandrangles . As the most tangible representa- 
tion of the Department’s survey efforts, the maps are tempting s\jrrogates for 
output products. More correctly, the maps are intermediate products to be 
used in forecasting and planning processes to follow. Nearly all the materials 
produced in the course of DWR's survey work - photos, cut and weigh pieces, 
quad sheets - fall into this category. They are media for storing information 
and not ends in themselves. The ultimate products, if there are any, material- 
ize along with comtless administrative decisions in the form of dams, irriga- 
tion channels, fish screens, etc. Land use survey information thus must be 
seen as just one node in an entire network of planning and decision-making pro- 
cesses . 

Irrigated Lands Project results should be viewed similarly. On a super- 
ficial level, nP’s "product" might be considered the irrigated acreage sta- 
tistics produced for ten counties. • But examination of the project's objectives 
reveals that HP is concerned more with developing an "operationally feasible 
proces's" than mth producing statistical products. To evaluate IIP strictly 
on the basis of its product runs the risk of overlooking its process .considera- 
tlors. How well is the HP process likely to mesh with DWR's land use survey 

^^partment of Water Resources, Land Use in California , BTilletin No. 176, 

. Decariber 1971, p. 3. 
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activities? What special technology transfer difficulties or opportunities 
are apparent? Are there ways of restmctiiring land use information -acquisition 
procedures within either ILP or DWR to better serve the Department's needs? 
Questions such as these are unlikely to arise if attention is focused exclu- 
sively on product contributions. 

6,3 Users . Organizations other than DWR enlarge the decision network in 
which the land use Information products are used. An informal listing re- 
cently prepared by DWR indicates a wide variety of uses and users of their 
land use maps.^ In addition to DVJR, the list Includes the following organi- 
zations : 

U.S. Bureau of Reclamation 

State Department of BT5>loyment Development 

State Department of Pish and Game 

State Department of Health 

University of California 

Economic Research Service 

Presno County Assessor 

Merced County Association of Governments 

Stanislaus Area Association of Governments 

Tulare County Planning Association 

lios Angeles Department of Water and Power 

Pacific Gas & Electric 

The Bureau of Reclamation and DWR both use the land use quadrangles in their 
water demand forecasting activities, mainly for estimating present water re- 
quirements, for projecting future crop acreage, and for locating remaining 
irrigable lands. Other agencies use the maps to locate the acreages of various 
crops, prime agricultural areas, or wildlife habitat, to facilitate local plan- 
ning functions, land appraisal, or environmental assessment, and to estimate 
farm labor requirements or to establish ground truth. 

These diverse applications suggest a land use survey system patterned 
after ILP might be able to supply information useful to other organizations 
as well as DWR. Evaluation of the current ILP, however, should proceed by 
assuming DWR would be the sole user of information resulting from an opera- 
tional system Incorporating ILP procedures. To do otherwise would require 
far more intensive research into the nature and extent of the applications 
outside DWR. 

6.4; Costs . To know only the purpose, outputs, and Intended beneficiaries 
of particular programs is insufficient for evaluating them.. Alternative 
approaches not only imply certain impacts or effects, but also include 
associated sacrifices or costs. Cost estimates supply much of the fabric 
from which program evaluations are woven. As a result, the assunptions 
and accuracies surrounding a program’s estimated costs deserve special 
scrutiny. Far too many evaluative tapestries, it turns out, are composed 
of shoddy materials or conceal numerous imperfections . The fact la there 
is no standard set of rules to be mastered in the evaluation trade. Instead, 
there is a set of general principles to' be combined on an ad hoc basis with 
an analyst’s' sensitivity, ingenuity, and good judgement. 

5 

Department of Water Resources, Staff Memorandum, 1976. 
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Approach. An evaluation of the cost picture sxarrounding IIP. leads direct 
ly'back to the original ”so what?" question. The objective here is to deter- 
mine, at- least from the standpoint of cost , whether ,an HP approach appears • - 
■worthwhile. This necessarily inplies comparisons with alternative approaches. 
In the context of this project, it means a comparison v/ith DlVR's land use 
survey approach, the only operational alternative available in California. 

At first Inspection, the two siArvey systems appear poorly suited to a 
conroarative evaluative framework. Their differences with regard to objectives 
products, and users have already been described. One system is developmental 
and aimed toward frequent Inventories of irrigated lands, while the other has. 
been employed for years to produce less frequent but far more detailed land 
use inventories. Moreover, 'meaningful cost conparisons are hard to come by 
because of differing compensation scales and a lack of directly comparable 
data. 


Stanislaus County provides the principal source of comparable DWR cost 
information. Not only is Stanislaus County one of the 10 IIP test areas, 
but it was also 'the site for Dl®’s land use survey inventory-- effort for 1975, 
the base year ‘for ILP. Stanislaus County is, in essence, the only point of 
geographical and temporal, overlap between the two survey systems . -Fortu- 
nately, the county’s land use diversity enhances its use as a point of com- 
parison, All that is needed is the assumption that DV/R’s costs per acre 
surveyed in Stanislaus County are representative of the unit costs DWS would 
have incurred had they themselves' surveyed all 10 ILP counties in 1975. 

Attention to the conceptual nature of these costs is necessary before 
plunging blindly ahead with an analysis . VDien one normally thinks of costs 
there is a tendency to 'focus on direct expenditures or what are defined 
usually as accounting costs. To properly evaluate programs from a social 
perspective, however, one needs broader concepts such as opportunity cost^ 
to better represent the social sacrifices associated with choices among al- 
ternatives. DWR’s contributions of photo interpretation and tabulation time, 
for ex^le, did not appear on HP's budget but were nevertheless part. of 
the project’s costs. Similarly, one needs to. exclude certain accoijnting 
costs to establish a fair basis of conparison. ' TIP's budget contains numer- 
ous development costs of a research nature that have no equivalent in DliJE's 
land use surveys. These costs cover project monitoring, special testing 
and experimentation, softvore development, periodic progress reports, and 
analytical postmortans like this section. 

Some preliminary attention should also go to\*rai?d constructing a suit- 
able framework for deriving cost information. The method of cost estima- 
tion used here is an "ingredients approach’’- consisting of two phases. The 
first phase involves writing a task-by-task description .of .the program, 
deciding what resource inputs or ingredients are accounted for. 'Typical 
ingredients include -personnel , facilities and equipment, materials, and 
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Table 9 . Cost data on DWR land use survey - Stanislaus County, 1975. 


• All LU Categories I rrigated. LU Only 

Assume: Z0% 25^ 

all LU all LU 


.PLAHNING 6 ADMINISTRATION 


coordination 

5d e $70/d 

$ 350 

DWR overtiead § 

105^ of salary 

370 


PHOTO ACQUISITION 


pilot & aircraft 

16h g $75/fi 

$1 ,200 

photographer 

20h g $l8/h 

360 

observer 

3d g $70/d 

2i0 

DWR’ overhead @ 105^ of 

salary 

220 

travel expenses 


100 

film 


70 

.processing 


280 


PHOTO INTERPRETATION 

field work 70d g $65/d 

OUR overhead @ 105% of 'salary 
travel expenses 

In-house work ^5d § $70/d 

OWR benefits % 105% of salary 


$^».550 

4,780 

1,960 

3,150 

3.310 


TABULATION 

cut 6 weigh (all LU) 65d @ $50/d $3,250 

cut & weigh (irrig LU) 5d § $50/d 
DWR overhead @ 65% of saiary 2,120 

materials 20 


-- $ 700 


»«$ 2,400 


^ $17.700 

-•V $20,800 


^ $ 5,400 

/V $26.200 


w$4,200 --$5,200 


$ - 
250 
160 
2Q 

— $ 400 /V S 400 
$4.600 >^$5.600 


Unit Costs (includes orchards 5 vineyards) 

600,000 acres observed 4.4^/ac 

-- 400, 000‘ Irrigated acres 


0.8(/ac - 0.9c/ac 
1 .2c/ac - i .4d/ac 
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Table. 10. Cost-data on ILP survey - 10 counties,- 1975. 


PLANNING s ADHINISTRATION ’ 


coordination 7Sd g $A5/d + I5d @ S70/d 

sample design 25d @ $6o/d 1,500 

RSRP overhead @ 50% of salary ~ 2 A40 

*0VIR overhead 0 65 ^ of salary *680 

computer time ’ Iqq 


PHOTO ACQUISITION* 


Aerial 


coordination 

12,5d % $6o/d 



$. 750 

pilot & aircraft 

• 75 h -g $ 50 /h 



3,750 

observer 

12 d '8 $ 50 /d 



600 

RSRP ove.Phead 0 

50% of salary 



gAO 

travel expenses 




. 90 

film 




210 

processing 

- 



1,060 

. Landsat 





coordination 

> lOd.g s^ 5 /d 



k $0 

RSRP overhead 0 

50^. of salary 



220 

imagery 




3,830 

processing 




200 

PHOTO INTERPRETATION 





Ground Data 





collection 

S^th g $ 45 /d 



300 

compi lat Ion 

20d g $A5/d 



900 ' 

RSRP overhead § 

50% of salary 



600 

travel expenses 

f 



1(50 

Aerial 





preparation 

17 d g $i» 5 /d 



770 

training 

8h g $li5/d + 

20h* 

e $7o/d 

220 

Interpretation 

72h g $A5/d + 

50 h* 8 $70/d 

850 

RSRP overhead @ 

50% of salary 



610 

*DWR overhead 0 

105% of salary 


- 

650 

Landsat 





preparation 

3 ^d g S50/d 



1 ,700 

training 

I6h 8 $60/d+ 

. 7 d* 

8 $ 70 /«l 

. 610 

Intepretation 

60 h g $50/d + 

52 h* 

8 $70/a 

830 

RSRP overhead § 

50% of salary 



1,100 

* 0 WR overhead § 

105 % of salary 



1,000 

travel expenses 

• 



60 


TABULATION . 

aerial 49 h f $«t5/d + 93h* § S60/d 1,020 

Landsat 32 h g $ 50 /d + i»8h* § $ 50 /d 500 

• RSRP overhead 6' 50 % of sa I ary 2 l |0 

*DWR overhead g 65%. of salary 680 


• f* % 9,200 


jy.'iOO 


$it .700 

$12,100 


$2,250 


$ 3,100 


$ 5,300 

e/$l 0,700 


2,1(00 

^ $ 3^.^00 


* ^ 

Unit Costs (excludes orchards S vineyards) 

3,707,000 acres observed 
^ 2 , 3 S 8,000 irrigated acres 


0 . 9 ^/ac 
1 .2^/ac 
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ndscellaneous inputs. The second phase Involves determining who bears the 
costs and v^ch costs should be taken into account. Client time, for in- 
stance, is, a cost often neglected in such calculations. 

Results . The two acconpanying tables set forth cost estimates associated 
with the major ingredients of DWR’s 1975 Stanislaus County survey and RSRP’s 
10-county Irrigated Lands Project. Activities within, both surveys are or- 
ganized into similar groupings: administration, photo acquisition, photo 

interpretation, and tabulation. In Table 9> costs estijTiated for the full 
Stanislaus County survey are reduced to reflect what the survey might have 
cost had it inventoried just irrigated and non-irrigated land use categories. 
Based on discussions with DWR personnel, it was assumed that the less anhi- 
tious survey could be performed at roughly 20^ to 25 ^ of full survey costs. 

The resulting ittiit costs appear at the bottom of Table 9- Since DWR’s 1975 
survey located some 400,000 irrigated acres in Stanislaus County, this works 
out to a cost of around 1.2^ to 1.4i for each irrigated acre observed. 

Table 10 portrays a corresponding set of costs for ILP. The cost cate- 
gories generally .follow the activities outlined in the ILP progress reports 
except that developmental costs are omitted. \iJhat remains are cost estimates 
associated with the "operational" conponents of ILP, i.e., those tasks direct- 
ly concerned with producing irrigated acreage statistics. The sum of these 
estimated costs is roi;i^ly $34,000; of this, the time and expenses contributed 
by D\'IR accounts for some 20^. With nearly 3,000,000 Irrigated acres included 
in the 10-county survey, ILP unit costs amount to about 1.2$ for each irrigated 
acre observed. 

Comparability . Superficially, the two sets of unit costs may appear 
directly comparable. Closer examination, hov/ever, reveals certain differences 
that coinplicate comparisons. One difficulty, reminiscent of classic "apples 
arid oranges" problems, is actually an "orchaixis and vineyards" problem. 

Sinply stated, the DWR survey included orchaords and vineyards, while the ILP 
survey excludes them. Regions known to contain relatively static parcels of 
irrigated acreage were eliminated from the ILP sample design at the suggestion 
of DWR personnel. These acreages conprise mainly orchards, vineyards, wildlife 
refuges, and military reservations. All DWR and ILP Irrigated acres, in other 
words, are not equal. 

The consequence of this dissimilarity on unit cost conparisons depends on 
the extra effort required to survey the excludable acreage. If the goal is 
just to separate irrigated from non-irrigated acreage, fruit trees are am.ong 
the easiest irrigated land uses to identify from aerial photography. Large 
segnents of unirrigated pasture and fallov/ land also are easily identifiable, 
especially with the. aid of multidate Imagery. A graphical conparison of the 
acreages involved in the two surveys appears in Figure 11. TMR's survey included 
around 600,000 acres in Stanislaus County, of which 2/3 was irrigated (including 
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some 100,000 acres in orchard' ) and 1/3 unirrigated. The 10-county ILP survey 
covered an' area roughly 6 times larger, divided 80:20, orchardless irrigated 
acres to nonirrigated acres. Stanislaus County acreage accounted for about 
8 % of the ILP survey ‘total. Rrom such facts and fi^jres, one might expect 
that if the two surveys had looked at the same kind of irrigated acreage, iLP’s 
relative unit cost picture, if anything, would be enhanced. 

Other inconsistencies onerge when the two lists of cost data (Tables 9 
and 10) are scrutinized. For instance, not all the estimates are of equal' 
precision. Photo acquisition costs, because they leave relatively tangible 
records, are the easiest to pin down. Photo interpretation and tabulation 
activities, consisting mainly of well-defined and repetitive tasks, provide 
the next most reliable level of cost data. Planning and administrative costs 
are the most difficult to untangle from the other categories and, hence, the 
least precise. The task of isolating administrative costs in HP is compli- 
cated further by the abundance of development costs related to research ad- 
ministration. A heavy reliance on subjective Judgement is thus essential 
for sorting out these Intermingled expenses. Yet care must be exercised bo 
avoid judgements that unfairly bias the conparatlve framework. Examination 
of the work here should. show that most judgements, if they exhibit bias at 
all, lean in favor of DWR’s survey system. The amorphous area of planning 
and administrative activities, for exanple, accounts for 27 % of the ILP 
survey’s toteil costs; in the conparatlve system, these tasks are estimated 
to consume only around 3 % of total costs. 

Additional differences become apparent upon inspection of the Individual 
cost data "ingredients”. DWR salaries and overhead rates generally exceed 
those applicable within the University’s Remote Sensing Research Program (RSRP) 
The hi^er rates, however, usually suggest greater experience, capabilities, 
benefits, or indirect costs. For exanple, 'the higher of DWR’s two overhead 
rates reflect added costs associated with maintaining field operations. In 
another case, it is obvious the two systems have differing photo acquisition 
costs. DWR’s aerial surveys originated in Merced, close to the survey site, 
using a pilot plus two men, whereas RSRP’s two-man team flew from Oakland while 
surveying the ILP counties. The two syst^ns also show divergent photo inter- 
pretation and tabulation costs, mainly because of the methodologies enployed. 
The DWR system, designed to differentiate between many crops, involves con- 
siderable direct observation of resources. Similarly, the D1® system favors 
a cut-and-weigh tabulation method (over Graf pen, for eiraitple) because it 
provides a permanent file of land uses. 


6 


The Stanislaus County Annual Crop Report for 197^5 shows 102,848 acres of 
bearing fruit and nut crops, of which about 25^000 acres are -vineyards. 
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estimated non-developmental ! LP costs excluding adml n » stratlon 
g” estimated total non-developmental IIP* costs 


Figure 12. Comparative unit costs: 

ILP survey vs. OWR survey of Stanislaus County, 1375. 
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Summary, Clearly, an assessment of the results and conparabillty Issues 
associated vd.th costs demands an analytical balancing act: on one hand, it is 
Important that the "trees" of conparative questions do not obscure the evalua- 
tive forest; on the other hand, it is essential that any conclusions are in- 
terpreted with knowledge of the shortcomings built into the evaluative frame- 
work. Figure 12 draws on the unit cost information in Tables 9 and 10 to 
illustrate conparisons between the two survey systems. Costs are conpared 
using two views of the "units" involved: irrigated acres only (left graph) 
and total acreage in the sanple region (right ^aph). The unit costs of both 
survey systems (in cents per acre) appear on the vertical axes, while the hori- 
zontal axes register the full costs of ILP (in thousands of dollars). Each 
graph shows two cost ranges for the DV/R survey, the lower range including- 
orchards and vineyards and the upper excluding them. Since the second cost 
range inplicitly assumes the additional cost of surveying the excluded acreage 
is zero, it represents an outside limit to estimates of DWR costs. The diago- 
nal lines indicate the range of unit costs that would result for an ILP survey 
(excluding orchards) at various budget levels. Point A, near the 425,000 level, 
shows the unit costs expected from an ILP budget Including cost estimates for 
photo acquisition, photo interpretation, and tabuilation activities. -Point B-, 
near the $3^,000 level, shows the same thing given the total estimate of non- 
developmental ILP costs. Planning and administrative cost estimates, in other 
words, account for the difference frcmi A to B. 

Figure 12 provides a natural opportunity to return to the "so what?" ques- 
tion. By momentarily putting aside structural dissimilarities and conparabillty 
difficulties, it is possible to reach a general conclusion: namely, as far as 
unit costs are concerned, ILP conpares favorably with a hypothetical- DWR-style 
survey of irrigated lands. In other words. Figure 12 shows estimated ILP costs 
falling into rougoly the same "ballpark" as DWR costs. This conclusion holds 
for conparisons involving both types of "units", using either the entire acreage 
surveyed or just irrigated acres alone i 

6^5'- Accuracies . Unit costs furnish one set of criteria for evaluating irri- 
gated lands survey methodologies. Information on survey accuracies provides 
another. Both criteria sets depend strongly on conparatlve judgements, and the 
results of these judgements in turn depend on what is being conpared. There 
are tv 70 basic ways of judging the accuracies achieved in ILP acreage estimates; 
(1) through an "internal" analysis of their statistical consistency, or (2) 
through an "external" conparison with the results of independent surveys of the 
same region. 

Since a description of the first approach appears in an earlier section.(pp. 
25-31), little on this subject needs repetition here. It should suffice to say 
that -although ILP failed to attain the accuracy levels established at the pro- 
ject's outset, the accuracies demonstrated under imperfect test conditions ^-jere 
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Table'll. Comparison of ILP irrigated acreage results with other surveys. 



[m 

m 

CD 

CQ 






1975 

1974 

1975 

1975 

Relative 


[EI-E3 

ts]-na 


rLP 

Census of , 

Annual Crop 

DWR 

Standard 

— 



County 


Agriculture^ 

Report 

LU Survey 

Error ^ 

' m ' 

m 

QQ 

Fresno 

• 1 , 0116,921 a 

1,102,53^a 

1 , 012,949 a 


- 4.8% 

- 5 . 0 % 

+ 3 . 4 % 


Madera 

144 , 720 

224,121 

212,525 


12.8 

-35*4 

- 31.9 


Merced 

399.290 

387.222 

389,655 ■ 


6.9 

+ 3.1 

+ 2.5 


Hon terey 

122,990 

206,04! 

231 ,288 


5*6 

-40.3*^ 

- -46. 8^ 


Plumas 

36, '•SS 

21,3622 

49,100 

' 

7 . 2 ® 

— 8 

- 25.7 


Sacramento 

182,453 

Iit8,738 

230,867 


13.7 

+22.7' 

-21,0 


San Joaquin 

486,287 

448,268 

505 , 500 3 


8.4 

+ 8.5 

- 3.8 


Sierra 

13.734 

5,6922 

22,600 


7 . 2 ^ 

8 

- 39,2 


Stanislaus 

295 . 1131 ' 

- 300,449 

272,398 

297,000“k 

5.9 

- 1.7 

+ 8.5 

-0.5* 

Sutter 

239.1i37 

196,220 

307,174 


7.1 

+22.0 

-22.1 


Total 

2,967.758 a 

3.040,647 a 

3.234,056 a 



- 2..4% 

- 8 . 2 % 



1 197 ^ Census of Agriculture, Preliminary Report. 

Z From 1969 Census of Agriculture;' unavai table for I 97 A Census until mid- 1977 . 

3 Increased by 50 O acres to reflect addition of nursery crops. 

Stanislaus is the only county here surveyed by DWR in 1975; total equals 400,000 acres less orchards and vineyards. 

5 From Table 8 ; no signs because figures are ratios. 

6 Plumas and Sierra Counties combined. 

7 Low figures reflect the exclusion of Monterey County lands outside the Salinas Valley. 

8 Omitted for lack of 197^ base year. 
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nonetheless encouraging. The original accwacy requirements, discussed, in 
earlier progress reports, were set at -3^ for a 99/S level of confidence. 

This means an observer should find irrigated acreage estimates to be within 
of the actual acreages in 99 out of 100 cases. ILP accuracies and con- 
fidence intervals were displayed in Table 8. There, results at the 99^ level 
of confidence were ^7.04^, Further iitprovement in these accuracy levels 
would have been likely had ILP sair 5 )led lands throxjghout the state. As it 
was, the ILP test area included roughly 1/3 of California's 9,000,000 irri- 
gated acres and thus about 1/3 of the strata needed to inventory the entire 
state. Other things equal, more strata woiild mean a lower standard error 
of estimate, and hence, greater overall accuracies. Similarly, ejqjerlence 
with HP indicates that restratification of certain counties would* signifi- 
cantly reduce interpretation errors. 

A county-by-Gounty comparison of ILP acreages with those of three in- 
dependent surveys appears within the eight columns of Table 11. Taken in 
their entirety, acreage estimates for the ILP counties .(column 1) are. about 
2 % less than coirparable estimates from the 1974 Census of AgricilLture (columns 
2 and 6) and around %% less than combined estimates from the 1975 county crop 
reports (columns 3 and 7). • The ILP acreage estimates for Stanislaus County 
are almost the same as In DWR's 1975 survey minus the county crop report esti- 
mate of orchards and vineyards (columns 4 and 8). Results for individual 
counties show considerably more variation between surveys. The list of IIP 
relative standard errors (column 5) is useful for reviewing the "internal" 
accuracy of county estimates beside their "external" counterparts. A com- 
parison that emphasizes irrigated acreage estimates within individual counties, 
however, overlooks ILP's fundamental objective, i.e., that of surveying irri- 
gated agriculture across very large regions. The bottom lines in Table 11 
suggest that ILP did that Job fairly well. By adding to this the results 
concerning ILP's "internal" statistical consistency, it is again possible 
to generalize: ILP results, when considered for the entire study area, closely 
approximate those of . ccarparable surveys and they do so at relatively high 
levels of accuracy . This statement is meant as another "ballpark" assertion, 
implying that abrogate ILP results demonstrate a range of credibility similar 
to that of more Intensive surveys. 

6, 6 Timeliness . The concept of timeliness introduces an important third 

dimension into the evaluation of any inf onmt ion-producing system. It is 
this perishable quality that can mean the difference between accurate, 
cost-efficient information and irrelevant words and digits. Obviously, what 
is timely and what is not must be determined by the purposes and priorities 
of the information users . Often decisions about timeliness are dominated by 
other decisions concerning the desired level of infornatlon detail. For 
example, the conprehensiveness (and associated expense) of DWR's land use 
inventory program has tended to restrict the coverage of their annual surveys. 
On the average, around 10 % to 20$^ of DWR's siirvey area is updated each year. 
Statewide estimates of irrigated lands, when required, are constructed from 
a mosaic of annual surveys, each adjusted and extrapolated to reflect recent 



land use changes. 


Parallel mfomation from two other statewide surveys also present time- 
liness and reliability difficulties. The Census of Agriculture, repeated at 
five-year intervals (1969 » unavailable until two to three years 

after the census year, wforeover, DWR personnel have found that the Census 
Bureau’s estimates of irrigated land in California farms, when they finatlly 
appear, often fall below DWR’s own estimates. Crop reports from .each of the 
County Agricultural Commissioners also provide a source of Information on 
Irri^ted acreage. While these reports are filed vjithin a year following 
the growing season, DWR finds that their reliability depends strongly on 
the county involved. Furthermore, neither the Census nor the crop reports 
furnish irrigated lands information in a spatial context consistent with DWR's 
own surveys. 

The possibility of establishing a relatively Inexpensive, consistent, 
and timely data base for monitoring statemde changes in irrigated land uses 
was the motivating idea behind IIP. At- the outset, the IIP approach was to- 
be capable of conpletlng a statewide survey of irrigated lands within one 
year, with results available six months later. Experience from IIP indicates 
that its design objectives concerning timeliness are still realistic. This 
conclusion bears little relationship to the project’s actual duration. As in 
many prototypes, the bulk of time spent on IIP was consumed by research and 
development details. Nevertheless, IIP has increased the likelihood that 
an "operaticnalized" IIP could indeed deliver a statewide inventory of irri- 
-lands within l8 months. Conpared with existing surveys, this sort of perfor- 
mance would place the IIP approach in a timeliness "ballpark” al l its own. 

6.7 Conclusions . The foregoing paragraphs, tables, and figures have al- 
ready outlined the fundamental conclusions apparent from an evaluation of 
IIP. A coitparison with DWR's land use survey program reveals numerous dif- 
ferences in objectives, products, and users. Despite these and other dis- 
similarities, it is possible to advance several tentative generalizations 
about the two approaches. In terms of costs and accuracies, the prototype 
system produces results in roughly the same range as the operational system. 

In terms of timeliness, an IIP approach promises an ln 5 )rovement over existing 
siirveys, but an actual demonstration of this ability has yet to be performed. 
In terms of all these areas, ?.t is possible to identify improvements that 
could further enhance the relative performance of the IIP approach: e.g., 
lower administrative expenses could greatly reduce costs j greater stratifica- 
tion could significantly iii 5 )rove accuracies; and additional practice would 
insure more timely results. 



It is important, however, to recognize that the "so what?" question 
really enconpasses more than the basic evaluative measures of cost, accuracy, 
and timeliness. Herein lies the subtle distinction between evalimtlon of a 
technology's results and the more comprehensive notion of technology assess- 
ment. Mere measures of relative performance can often overlook critical 
characteristics of the social environment into which a new technology is being 
introduced. While a thoroughgoing assessment of an ILP-style approach reaches 
beyond the scope of the study here, a glance at two assessment-related 
questions is in order: VJhat types of changes could implonentatlon of an ILP 

system produce? In what areas would an ILP system be of greatest value to 
DWR? 


The first question relates to the probable side effects associated with 
a transfer of ILP technology. These considerations frequently escape more 
formalised evaluative procedures because they possess poor visibility, or 
defy meaningful quantification, or both. Failure to adequately assess and 
anticipate such "intangibles" can deny success to any technology transfer 
effort. From DWR's standpoint, inplementation of an Irrigated lands program 
patterned after ILP might be expected to raise legitimate concerns about the 
following sorts of changes: 

“ Changes in activities. A reexamination of the cost data in Tables 
9 and 10 Indicates some of the activity differences between the 
two survey approaches. ILP involves . less direct observation of the 
agricultural resource- and more in-house photo interpretation work. 

For those who prefer "windshield surveys" to stereoscopes, such 
activity changes might result in lower Job satisfaction. Of the 
DWR employees who participated in the ILP photo interpretation 
work, most had favorable ccmients about the activity, although 
several admitted it was "somewhat tedious" and should be performed 
in smaller doses. 

° Changes in budget. The possibility that any savings generated 
by new methods would result in reduced budgetary discretion is a 
concern very real to agencies exploring new technologies. Whether 
ILP is likely to have any effect (positive or negative) on DWR's 
bu^eted resources is xinanswerable at this time. Much depends on 
the reaction of state officials to the post-ILP survey work. 

° Changes in equipment. For the most part, an ILP approach is immune 
from the sorts of "people vs. machine" controversies that acconpany • 
many high technology applications. Outside of extra stereoscopes 
and acetate overlays, ILP -uses very little equipment or naterial 
not already used by DWR in their own surveys. ILP in’ its present . 
fom requires only a small amount of conputer time for its sample 
.design'-fflTd statistical package, although the approach could be 
adapted to automatic analysis procedures. The greatest equipment 



difference between the two survey systems is one of format: CWR ' 

relies almost exclusively on 35nm low altitude photography while 
ILP uses color prints. Concern that an ILP-style system would 
force DWR to "use or lose" their 35nm equipment seems unfounded. 

® Changes in Infonnation. ILP’s product ^ — Irrigated acreage estimates 
over large areas — differs in scope and detail from its DWR counter- 
part. Should an HP successor be integrated into DWR's land use 
survey program, it is conceivable that the new information mix would 
differ from the existing configuration. How this might affect DWR 
ope 2 ?ations and the interests of outside users is problematic. Pre- 
sumbly DWR would not inplement an IIP approach if the result did 
not yield some information Improvement. 

® Changes in Jiirlsdiction. A related issue concerns the possibility 
that new information combinations might alter existing jurisdictions 
over, information sources. Land use information of various types is 
conmon’to many government agencies, and changes initiated by one agency 
sometimes affect the others. Efforts to consolidate the Informa- • 
tion-gathering activities of state agencies undergo periodic revlvaly 
and it Is possible that an ILP-style system, because of its synoptic 
data base, could either influence or be influenced by such developments. 

° Changes in skills. One of the successes of ILP has been a demonstra- 
tion of ease with vhich interpretative skills may be transferred to 
DWR employees. The project involved some 70 hours of training and 
interpretation designed to acquaint DWR land use survey specialists 
with the ILP methodology. Presumably, the familiarity of these om- 
ployees with aerial photographs and the resources in their respective *• 
areas greatly sinplified the skills transfer task.. Longer training 
sessions probably woirld be required for persons with less of a "head 
start". 

The second assessment-related question is really the bottom line in all 
technology transfer programs: Where will technology X be of greatest value to 

user Y? It is one thing deciding vfiiether ILP represents a "better mousetrap". 

It is quite another thing deciding whether there are enough mice to .justify 
the trap. There is also the possibility that the contraption should be entirely 
redesigned for some other kind of pest. 

Recent DWR activities give clues to their interest in "pest control" 
matters. The current drought in California, unde3?way since 197 5 j has served 
to Increase the value of infomation on irrigated agriculture. Last year, 

DWR undertook one of the largest land use suarveys they have conducted in 
years — the entire Sacramento Valley. This year, it is likely, DVJR will 
perform a similar survey covering the San -Joaquin Valley. Much of this 


^Por example, see Legislative Analyst, State of California, 'Water Resources 
Planning and Agricultural Water Needs," January, 197 3- 
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accelerated survey activity is a reaction to changing (and drought-related) 
information needs. DVJR is particularly interested in detennining how a 
record dry year affects their hydrological models. Also, they hope to observe 
how cropping patterns change given the prospect of reduced tvater deliveries. 
Common to both interests is the desire to survey large areas during the same 
growing season. 

Perhaps DWR’S desire for frequent and extensive land use information 
win subside when more "normal" water years return. 'But if it achieved 
little else, ILP has provided state agency employees first-hand experience 
with an alternative procedure .for acccanplishing scxne of their land use sur- 
veying responsibilities. The fact that the procedure uses spaceage remote 
sensing technology is not so inrportant as its ability to help real users 
solve their information collection problems. 

Several ILP follow-on projects — one in progress, others in planning 
stages — demonstrate that ILP will be more than a one-shot research proj ect . 
Outside its cost, accuracy, and timeliness performance characteristics, ILP’s 
versatility and fundamental sinplicity appear to be its strongest attributes. 
Crop identification abilities can be incorporated into the ILP approach with 
relative ease. Similarly, automatic analysis procedures can be Introduced 
into the procedure if the scope and diversity of the sanrole area Is suitable. 
Both of these variations will receive greater attention in the post-ILP pro- 
jects. ■ Yet while experimentation with refinanents ultimately should help 
the ILP approach better match DWR's needs, it is certain little progress 
could be made without the continued support and understanding of DWi personnel. 
And here, as usual, the keys are understandability and responsiveness to user 
needs. J/Jithout these qualities fii^y birllt into their core", 'few "nraus'etfaps", 
no matter how elaborate, can expect to succeed at "state and local user levels, 

7.0 Simmary of the Besearch Project 

Irrigated T.gn ds Project had three main goals that guided the design and 
implanehtation of the research; (1) to develop an operationally feasible process 
whereby satellite imagery of the tj^e obtained from Landsat can be used to 
iprovide irrigated land acreage statistics on a regional basis; (2) to develop 
'a technique that would enable EWR to perform this inventory for the entire state 
of California in a one year period and. have the data available for piablication 
within six months following the end of the calendar year of the inventory; and 
(3) to achieve a level of accuracy for the test area and the state to within + 
3% at the 99% level of confidence. I^iese goals were addressed by the design 
and inplanentation of a multiphase sanpling schsne that was founded on the 
utilization of a Landsat-based ronote sensing system. Ihe synoptic coverage of 
Landsat and the eighteen day orbit cycle allowed the project to study 
agricultural test sites in a variety of environmental regions and axmtor the 
develoOTient of crops throughout the major growing season. The capability to 
utilize multidate imagery is crucial to the reli^le estimation of irrigated 
acreage in California where imiltiple cropping is widespread and current 
estimation systens must rely on single date survey tedmiques. In addition, the 
magnitude of agricultural acreage in California (DWR estimates it to he 12 
million acres) makes estimation by conventional methods inpossible. The project 
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dononstrated that reliable estimates of- irrigated acreage' could be made using 
a Landsat-based remote sensing systan and the multiphase sanpling design. . Since 
IWR is aco^tccied both to flying their own large scale aerial photcgr^hy and 
collecting ground data, tile inplementation of these two phases in their operational 
survey systan should- be relatively easy. Furthermore, IWR personnel actively 
participated in the interpretation and tabulation phases and' are cognizant of 
the techniques required for this part of the estimation. - - 

In terms of costs and accuracies , tMs initial ILP system produced results 
in approximately the same range as the operational IWR system. Although an 
actual demonstration of the timeliness of- the HP systan has yef^to be preformed 
it spears that the Landsat b^ed systan .premises an inprovonent over existing 
surveys. Based on 'the results of the study, it is possible to offer seme 
reccraneridations that could improve the performance of the ILP approach. 

Qie major reccranendation is that of applying a detailed stratification for 
more optimum allocation of ScSiple units. Ihis stratificaticn would be based on 
cropping practices/envircraiiental conditions as they affect both irrigation 
procedures and inteq>retation techniques. Minor revisions such as reori^ting 
the directicn of the Phase II sample units to north-south are also suggested. 

Hiis reorientation does not affect the sanpling design and importantly does- 
integrate into DWR's standard county survey techniques. 

Uie success of the project has depended greatly on the continuing growth 
of interest- and participation by the California Department of Water Resoiarces. 

strengthening cooperative interaction has led to follow-on project work ' 
in vdiich vie (DWR and the University of California) will inplonent the 
reconmendations derived fran this research on a larger regional demonstration 
and expand the research to include conputer assist^ analysis techniques and' 
crop identificaticn procedures. 


49 



Appendix A. Matched phases used in MPHASE to coirpute the estimate of • 
irrigated acreage. The numbers shorn are the proportion 
of each sanple unit interpreted as irrigated at each phase. 


County 


Fresno 


Madera 


Merced 


Sample Unit 

Phase I 

Phase II 

. Phase III 


(Landsat ) 

(Large scale aerial 
photography) 

(Ground Data) 

PROS 

.91 

.91 

• 94 

PR05 

.84 

.83 

.83 

FFa4 . 

.90 

.92 

.93 

PROl 

.97 

.98 

PR02 

1.00 

1.00. 


FR04 

.88 

1.00 


FR06 . 

.72 

.71 


FR07 

.68 

.70 


FR08 

1.00 

1.00 


FR09 

.65 

.70 


FRIO 

.90 

1.00 


FRll 

.8l 

.79 


FR12 

.81 

.96 


FR13 

.95 

.94 


FR15 

.94 

1.00 


FR16 

1.00 

.99 


FR17 

.85 

.88 


FR18 

.92 

.88 


FR19 

.66 

.99 


PR20 

.73 

.78 


PR21 

.67 

.54 


FR22 

.85 

.66 


FR23 

.93 

.76 


FR24 

.96 

.95 


FR25 

.95 

.94 


MA03' 

.43 

.69 

.56 

MAOl 

.90 

.92 

MJ^02 

.51 

.51 


imu 

.79 

.67 


MA05 

.78 

.90 


MA06 

.35 

.43 


MA07 

.76 

.76 


ME06 

.91 

.87 

.88 

r>E07 

.68 

.89 

.86 

MEOl 

.77 

.75 


ME02 

.82 

-.73 


ME03 

.44 

.41 


i®:o4 

.86 

.79 


ME05 

.87 

.•86 


ME08 

.68 

.79 


• ME09 

.63 

.76 
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Appendix a. Continued 


County 

Sanple Unit 

Phase I 

Phase II 

Phase III 



(Landsat ) 

(Large scale aerial 

(Ground Data) 


• 


photography) 


Monterey 

M002 

.81 

.83 

.86 


M003 

.82 

.77 

.82 


MOOl 

.81 

.79 


- 

MOO^ 

• .67 

.73 



M005 

.62 

.64 



K006 

.10 

■ .03 



r4007 

.82 

.83 

r 

Plumas 

PLOl* 

.27 

.30 

.27 


PM2 

.06 

.05 

.05 

Saciamento 

SAOl 

.51 

.51 

.54 


SA02 

.34 

.50 


SA03 

.02 

.06 



SA04 

.45 ■ 

.42 



SA05 

.75 

.77 



SA06 

.37 

.36 



SA07 

.58 

.50 


San Joaquin 

SJ08 

.51 

.53 

.56 


SJOl 

.97 

.83 


SJ02 

.64 

-.67 



SJ03 

.43 

.43 



SJ04 

.30 

.30 



SJ05 

.82 

.78 



SJ06 

.94 

.95 



SJ07 

.13 

.14 



SJ09 

.73 

.65 



SJIO 

.83 

.77 



SJll 

.95 

.94 



SJ12 

.87 

.83 



SJ13 

.81 

.88 . 



SJ14 

.46 

.47 


Stanislaus 

ST03 

.96 

.97 

.98 


ST06 

.58. 

.66 

.57 


STOl 

.96 

.92 


S102 

.83 

.88 



ST04 

.92 

.89 

- 


STO5 

.94 

.88 



ST07 

.34 

.34 



ST08 

.56 

.59 



ST09 

.40 

.-41 



Plumas Hatching phases were also used for Sierra County 
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Appendix 

County 

Sutter 


a: Continued 


Sairple Unit Phase I 
' (Landsat) 


Phase II Phase III 

(Large scale aerial- (Ground Data) 
photography^) 


SU07 • 

1.00 

.79 

SU08 

.73 

.68 

SUOl 

.50 . 

.59 

SU 02 

.73 

.52 

SUO3 

.57. 

.51 

SUOit 

.^12 

.40 

SU 05 

.75 

,80 

SUO6 

.98 

.92 


.98 

.72 
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